Systematic Comparison of Decision Accuracy of Complex Compensatory Decision Rules Combining Multiple Tests in a Higher Education Context          下载免费PDF全文

Iris E. Yocarini  Samantha Bouwmeester  Guus Smeets  Lidia R. Arends 《Educational Measurement》2018,37(3):24-39

This real‐data‐guided simulation study systematically evaluated the decision accuracy of complex decision rules combining multiple tests within different realistic curricula. Specifically, complex decision rules combining conjunctive aspects and compensatory aspects were evaluated. A conjunctive aspect requires a minimum level of performance, whereas a compensatory aspect requires an average level of performance. Simulations were performed to obtain students' true and observed score distributions and to manipulate several factors relevant to a higher education curriculum in practice. The results showed that the decision accuracy depends on the conjunctive (required minimum grade) and compensatory (required grade point average) aspects and their combination. Overall, within a complex compensatory decision rule the false negative rate is lower and the false positive rate higher compared to a conjunctive decision rule. For a conjunctive decision rule the reverse is true. Which rule is more accurate also depends on the average test reliability, average test correlation, and the number of reexaminations. This comparison highlights the importance of evaluating decision accuracy in high‐stake decisions, considering both the specific rule as well as the selected measures.  相似文献   

Generation Psy: Student characteristics and academic achievement in a three-year problem-based learning bachelor program     

Björn B. de Koning  Sofie M.M. Loyens  Remy M.J.P. Rikers  Guus Smeets  Henk T. van der Molen 《Learning and individual differences》2012,22(3):313-323

This study investigated the simultaneous impact of demographic, personality, intelligence, and (prior) study performance factors on students' academic achievement in a three-year academic problem-based psychology program. Information regarding students' gender, age, nationality, pre-university education, high school grades, Big Five personality traits, intelligence (i.e., numerical, verbal, spatial), observed learning activities, and self-study time was collected among almost 1800 students enrolled in this psychology bachelor program at Erasmus University Rotterdam between 2003 and 2009. Academic achievement was measured by students' yearly number of acquired credit points, a course test, and a knowledge progress test. Multiple regression analyses showed that observed learning activities, first- and second-year performance, high school grades, conscientiousness, and verbal ability were most strongly and consistently related to academic achievement in the bachelor. Other student factors also contributed to academic achievement, but their influence was less prominent and mainly restricted to the first year. These results suggest that (prior) educational achievements and observable learning activities are most important for academic success in a problem-based learning bachelor program.  相似文献   

Comparing problem-based learning students to students in a lecture-based curriculum: learning strategies and the relation with self-study time     

Marit Wijnen  Sofie M. M. Loyens  Guus Smeets  Maarten Kroeze  Henk van der Molen 《European Journal of Psychology of Education - EJPE》2017,32(3):431-447

In educational theory, deep processing (i.e., connecting different study topics together) and self-regulation (i.e., taking control over one’s own learning process) are considered effective learning strategies. These learning strategies can be influenced by the learning environment. Problem-based learning (PBL), a student-centered educational method, is believed to stimulate the use of these effective learning strategies. Several aspects of PBL such as discussions of real-life problems, selecting literature by the students themselves, and formulating answers to learning issues encourage students’ use of deep processing and self-regulation. In the present study, third-year PBL law students were compared to third-year law students of a lecture-based program with respect to their learning strategies, which were measured with the Inventory Learning Styles (ILS; Vermunt in British Journal of Educational Psychology, 68, 149–171, 1998). In addition, the relation between time invested in self-study and learning strategies, when taking the instructional method into account, was explored. Results showed that PBL students reported to apply deep processing, self-regulation, and external regulation more frequently than their non-PBL counterparts. PBL seems to contribute to the use of effective learning strategies, but PBL students also relied more often on external sources for their regulation, such as teachers, course material, and assessment.  相似文献   

Allowing course compensation in higher education: a latent class regression analysis to evaluate performance on a follow-up course     

Iris E. Yocarini  Samantha Bouwmeester  Guus Smeets  Lidia R. Arends 《Assessment & Evaluation in Higher Education》2020,45(5):728-740

Abstract

In this study, the consequences of allowing course compensation in a higher education academic dismissal policy are evaluated by examining performance on a second-year follow-up (i.e. sequel) course that builds on material from a first-year precursor course. Up to now, differences in the consequences of compensation on student performance across groups of students who portray different unobserved study processes were not considered. In this study we used a latent class regression model to distinguish latent groups of students. Data from two undergraduate curricula were used and latent classes were formed based on similar patterns in averages, variability in grades, the number of compensated courses, and the number of retakes in the first year. Results show that students can be distinguished by three latent classes. Although the first-year precursor course is compensated in each of these latent classes, low performance on the precursor course results in low performance on the second-year sequel course for psychology students who belong to a class in which the average across first-year courses is low and the average number of compensated courses and retakes are high. For these students, compensation on a precursor course seems more likely to relate to insufficient performance on a sequel course.  相似文献   

Assessing student teachers’ reflective writing through quantitative content analysis     

Eric Poldner  Marieke Van der Schaaf  P. Robert-Jan Simons  Jan Van Tartwijk  Guus Wijngaards 《欧洲师范教育杂志》2014,37(3):348-373

  相似文献   

Is problem-based learning associated with students’ motivation? A quantitative and qualitative study     

Marit Wijnen  Sofie M. M. Loyens  Lisette Wijnia  Guus Smeets  Maarten J. Kroeze  Henk T. Van der Molen 《Learning Environments Research》2018,21(2):173-193

In this study, a mixed-method design was employed to investigate the association between a student-centred, problem-based learning (PBL) method and law students’ motivation. Self-determination theory (SDT) states that autonomous motivation, which is associated with higher academic performance, can be reached when there is fulfillment of three psychological needs: autonomy, competence and relatedness. PBL aims to trigger autonomous motivation. In Study 1, 85 PBL law students (37% male; Mean age = 21.99 years) and 69 law students of a lecture-based, non-PBL program (39% male; Mean age = 22.72 years) filled out the Self-Regulation Questionnaire and an adapted version of the Work-related Basic Need Satisfaction Scale in order to measure autonomous and controlled motivation and perceived autonomy, competence and relatedness. In order to compare both groups, two MANOVAs were conducted and results showed differences neither in autonomous and controlled motivation, nor in feelings of autonomy and competence. However, PBL students experienced more relatedness. Additionally, in Study 2, focus-group discussions that were conducted indicated that PBL contains both autonomy-supportive and controlling elements, which might explain why no differences were found in perceptions of autonomy and autonomous and controlled motivation between PBL and non-PBL students. Furthermore, students reported that tutorial groups in PBL contributed to feelings of relatedness.  相似文献   

Quantitative content analysis procedures to analyse students’ reflective essays: A methodological review of psychometric and edumetric aspects     

E. Poldner  P.R.J. SimonsG. Wijngaards  M.F. van der Schaaf 《Educational Research Review》2012,7(1):19-37

Reflective essays are a common way to develop higher education students’ reflection ability. Researchers frequently analyse reflective essays based on quantitative content analysis procedures (QCA). However, the quality criteria that should be met in QCA are not straightforward. This article aims to: (1) develop a framework of quality requirements for QCA; and (2) explore the extent to which QCA studies of students’ reflective essays meet these quality requirements. First, a methodological review of psychometric and edumetric criteria for QCA is conducted, resulting in a framework with required quality criteria. Second, 18 studies were selected in which QCA was used to analyse students’ reflective essays. These studies were scrutinised using the developed framework. The results showed that none of the selected studies met all requirements. It is concluded that QCA procedures for analysing students’ reflective essays need improvement and that the developed framework can be used to improve and evaluate these procedures.  相似文献