共查询到20条相似文献，搜索用时 15 毫秒
1.
Overcoming the potential dilemma of awarding the same grade to a group of students for group work assignments, regardless of the contribution made by each group member, is a problem facing teachers who ask their students to work collaboratively together on assessed group tasks. In this paper, we report on the procedures to factor in the contributions of individual group members engaged in an integrated group project using peer assessment procedures. Our findings demonstrate that the method we used resulted in a substantially wider spread of marks being given to individual students. Almost every student was awarded a numerical score which was higher or lower than a simple group project mark would have been. When these numerical scores were converted into the final letter grades, approximately one-third of the students received a grade for the group project that was different from the grade that they would have received if the same grade had been awarded to all group members. Based on these preliminary findings we conclude that peer assessment can be usefully and meaningfully employed to factor individual contributions into the grades awarded to students engaged in collaborative group work. 相似文献
2.
Edmond Alkaslassy 《Assessment & Evaluation in Higher Education》2011,36(3):367-375
There are many reasons to assign group projects but determining the grade for each individual working in a group can be problematic. Self and peer assessments of contributions to a group project can be used to adjust individual grades. Most studies of such assessments have considered teams with three to seven members. This study documents the degree of congruence between self and peer assessments of contributions to a project assigned to teams of two people. The majority of students (88.6%) assigned equal credit to themselves and to their partner. Only 16.2% of students had their grades adjusted by the assessment process and most of those adjustments were small. These findings may alleviate concerns of instructors and students about the fairness of assigning individual grades to students working on a project in teams of two. 相似文献
3.
Ciprian Spatar Henny Mills Vedrana Kutija Martin Cooke 《Assessment & Evaluation in Higher Education》2015,40(3):371-389
Group work can form a substantial component of degree programme assessments. To satisfy institutional and student expectations, students must often be assigned individual marks for their contributions to the group project, typically by mapping a single holistic group mark to individual marks using peer assessment scores. Since the early 1990s, various mapping methods that use self- and peer ratings have been developed. They are based on (normalised) individual weighting factors, partial scaling of the group mark, inter-rater agreement corrections or parabolic functions. We show that no single existing method can be successfully applied to most practical peer assessment scenarios such as different marking scale interpretations, intra-group ranking errors, biased free-riders and marks exceeding 100%. We present a combined analytical mapping method that incorporates the benefits of existing mechanisms, but alleviates their weaknesses with minimum computational effort and tutor input. The robustness of the method is illustrated through problematic assessment examples and empirically evaluated in multiple group work environments involving a total of 243 students and five different disciplines. 相似文献
4.
5.
Sebastián G. Guzmán 《Assessment & Evaluation in Higher Education》2018,43(6):893-907
Group projects are widely used in higher education, but they can be problematic if all group members are given the same grade for a project to which they might not have contributed equally. Most scholars recommend addressing these problems by awarding individual grades, computing some kind of individual weighting factor (IWF) from peer and (sometimes) self-assessments, which is then multiplied by the group grade to generate an individual grade. Several variants of the IWF method have been proposed, sometimes with complex algorithms. However, theory suggests they are inaccurate and their accuracy has not been evaluated. This article uses Monte Carlo experiments to assess the accuracy of the original IWF method and variants proposed in the past decade. Findings show that the earlier, simpler methods work best and that self-assessments should definitely be avoided. 相似文献
6.
Sung-Seok Ko 《Teaching in Higher Education》2013,18(3):301-314
This study proposes an advanced method to factor in the contributions of individual group members engaged in an integrated group project using peer assessment procedures. Conway et al. proposed the Individual Weight Factor (IWF) method for peer assessment which has been extensively developed over the years. However, most methods associated with IWF use a simple average algorithm which still has limitations in effectively reflecting abnormal situations. Therefore, this study proposes an iterative method for measuring a fair IWF by considering each assessor's reliability. The proposed algorithm considers each assessor's reliability which is evaluated by an analysis of variance of the scores given by the assessor. This relative reliability factor is used to improve the fairness of the IWF and reduce the effect of unfair or unreliable assessors' scores. A comparison with previous methods demonstrates that the proposed method resulted in substantially more fair grades being given to individual students for group projects. 相似文献
7.
Jin Liu Xiuyan Guo Ruiqin Gao Paul Fram Yu Ling He Zhang 《Assessment & Evaluation in Higher Education》2019,44(6):835-847
Peer assessment can be conducted online with rapid development of online learning technology. The current study was conducted empirically to investigate peer rating accuracy and student learning outcomes in online peer assessments, comparing compulsory and voluntary peer assessment. Section 1 (N?=?93) was assigned to the voluntary group and Section 2 (N?=?31) was assigned to the compulsory group. The results showed the voluntary group scored significantly higher than the compulsory group in the final task of the course, while there was no significant difference on the final task score increase. Students who participated in the voluntary group provided more accurate scores (i.e. peer rater accuracy) than those who participated in the compulsory group. The peer score leniency/severity rating, comparing peer assigned scores with the teacher assigned scores, were generally consistent with the peer rater accuracy results. The current study offers insights for researchers who are interested in studying the effect of online peer assessment activities. The results are also of interest for instructors who may want to conduct peer assessments in online courses and are choosing between compulsory and voluntary formats. 相似文献
8.
S.A. Barringer 《Journal of Food Science Education》2008,7(3):47-53
ABSTRACT: The busy instructor wants to help their students learn but is often pressed for time. This article presents 6 grading techniques that help the students learn without taking a lot of time. First, not grading an assignment saves time and can still be valuable as long as the instructor carefully structures it so the students still have an incentive to complete the assignment and still learn from the assignment. Second, students can grade their own assignments and receive immediate feedback on the correct answer using commercially available scratch off sheets. Third, giving team rather than individual grades encourages peer tutoring as long as teams are carefully managed. Fourth, in-class peer grading lets students learn from each other, by reading how others did the assignment and discussing it with their team. Fifth, doing an in-class grading lecture over all of the students' assignments at once allows you to give feedback on common mistakes and is especially helpful when students are unclear on the assignment. Sixth, a grading rubric saves time writing comments and helps the students understand exactly what is expected and is the basis for their grade. These techniques can save time in grading while helping the students to learn the material better. 相似文献
9.
《The Journal of educational research》2012,105(5):208-211
AbstractThin study examined the effects of Interaction with “warm” teachers or “friendly” peer leaders on the scholastic achievement and conformance of underachievers. One experimental group of 28 seventh, ninth and tenth grade underachievers was assigned to “warm” teachers for nine months; each member of a second group of 31 underachievers was paired with a friendly peer leader for four months. Following treatment periods, experimental and control groups were compared on achievement and conformance variables. Significant differences were noted In teachers’ grades, tardinesses and severity of disciplinary offenses for the peer leader treatment and In frequency and severity of disciplinary offenses for the “warm” teacher condition. 相似文献
10.
Christopher L. Camp Jeremy K. Gregory Nirusha Lachman Laura P. Chen Justin E. Juskewitch Wojciech Pawlina 《Anatomical sciences education》2010,3(2):64-72
Professionalism is a core competency of medical training that requires students to develop the skills of providing and receiving feedback. Our study evaluated the effectiveness of delivering feedback in a group setting compared with an individual setting. The first‐year class of Mayo medical students (n = 49) enrolled in gross anatomy (in dissection teams), completed weekly anonymous evaluations of themselves and their teammates regarding seven aspects of professionalism (altruism, compassion, respect, honesty/integrity, responsibility, commitment to excellence, and self‐reflection). Professionalism scores from these surveys were calculated using a six‐point Likert scale. Students were also asked to comment on strengths and possible areas for improvement on each peer. At the midpoint of the course, peer comments and professionalism scores were shared with students in debriefing sessions either individually or with their team. Analysis of preintervention and postintervention professionalism scores indicated that the students receiving feedback in a one‐on‐one setting (student and instructor) were more likely to demonstrate higher scores on subsequent evaluations as compared with those students receiving feedback in a group setting (all team members and one instructor). Our findings suggest that providing feedback to first‐year medical students on an individual basis is the best way to improve professional attitudes and behaviors. Anat Sci Educ 3: 64–72, 2010. © 2010 American Association of Anatomists. 相似文献
11.
Donald W. Zimmerman 《教育心理学家》2013,48(3):175-178
If letter grades assigned in a course are determined by the percent of objective test items answered correctly, then under various assumptions about the mean and standard deviation of normally distributed test scores, the distribution of the percent of students receiving each letter grade is highly anomalous. Conversely, if one insists that letter grades be “reasonably” distributed and at the same time determined by a typical percentage scheme, then allowed test parameters are severely constrained and not the ones which psychometricians consider most defensible. One recourse available to an instructor who does not wish to grade “on the curve” is to adjust the test parameters to dubious values by manipulation of item difficulty so that a desired grade distribution based on percentages is achieved. This informal adjustment procedure constitutes an indirect and inefficient method of employing test norms — in effect, grading “on the curve.” 相似文献
12.
Daniel Jeffery Krassimir Yankulov Alison Crerar 《Assessment & Evaluation in Higher Education》2016,41(1):127-140
The psychometric measures of accuracy, reliability and validity of peer assessment are critical qualities for its use as a supplement to instructor grading. In this study, we seek to determine which factors related to peer review are the most influential on these psychometric measures, with a primary focus on the accuracy of peer assessment or how closely peer-given grades match those of an instructor. We examine and rank the correlations of accuracy, reliability and validity with 17 quantitative and qualitative variables for three senior undergraduate courses that used peer assessment on high value written assignments. Based on these analyses, we altered the single most significant variable of one of the courses. We demonstrate that the number of reviews completed per reviewer has the greatest influence on the accuracy of peer assessment out of all the factors analysed. Our calculations suggest that six reviews must be completed per reviewer to achieve peer assessment that is no different from the grading of an instructor. Effective training, previous experience and strong academic abilities in the reviewers may reduce this number. 相似文献
13.
Dominique M. A. Sluijsmans Saskia Brand-Gruwel Jeroen J. G. van Merriënboer 《Assessment & Evaluation in Higher Education》2002,27(5):443-454
The implementation of peer assessment receives much attention in teacher education. This paper reports the effects of peer assessment training on the performance of student teachers. Ninety-three student teachers were randomly assigned to control groups and experimental groups. The experimental groups were trained in defining performance criteria, giving feedback and writing assessment reports. This was done through peer assessment tasks that were embedded in a redesigned course. Analyses of data derived from peer assessment reports written by the students showed that the experimental groups surpassed the control groups in the quality of the assessment skill. As a result of the training, students from the experimental groups also scored significantly higher grades for the end products of the course than students from the control groups. The results of the questionnaire showed that all students were significantly more satisfied with the redesigned course. 相似文献
14.
One major challenge in using group projects to assess student learning is accounting for the differences of contribution among group members so that the mark assigned to each individual actually reflects their performance. This research addresses the validity of grading group projects by evaluating different methods that derive individualized scores from group work. Both Monte Carlo simulation and real test data analyses were conducted. The four investigated methods are the within-group adjustment method, the partial adjustment method, the between-group adjustment method, and the expected contribution adjustment method. For all methods, a weighting factor is computed based on the peer and self ratings of contributions to the group project by group members. This study finds that individual differences have to be taken into account if group grades are going to be assigned and utilized for evaluating individual performance at all. Adjusting contribution differences based on peer and self ratings could be an effective way to improve the validity of group grades. Among the four studied methods, adjusting both the within-group and between-group contribution differences is the most effective, and is thus recommended for classroom use. 相似文献
15.
16.
A. Mark Langan David M. Shuker W. Rod Cullen David Penney Richard F. Preziosi C. Philip Wheater 《Assessment & Evaluation in Higher Education》2008,33(2):179-190
There are many influences on how assessors grade themselves and others. Oral presentations are useful for exploring such factors in peer, self‐ and tutor marked assessments, being rapidly completed and assessed, commonly used in HE and very difficult to anonymize. This opportunistic study examined the effects of gender and level of attainment on the triangulation of marks awarded to student presenters. Grades generated by peer assessment were associated more strongly with tutor‐awarded marks than those from self‐assessment. For self‐assessment there was a strong effect of gender (female students undervalued their performance compared with tutor grades). Peer assessment produced higher marks than from tutors, perhaps because of the close‐knit community developed during residential courses. For tutor marks, the greatest variability was at the lower end of the scale, whereas peer assessors were most variable when marking students who self‐evaluated or peer assessed highly. Students awarded a narrower range of marks to peers compared with tutors, but when self‐assessing used a larger range. Presentations by students who admitted to little sleep the night before received lower grades from both peers and tutors, but this was not reflected by self‐assessments, suggesting they were unaware of their poorer performances. Sessions with fewer talks (four rather than seven) reduced the ‘dip’ in marks previously observed in the middle of sessions. Findings are discussed in the context of bias in this mode of assessment. 相似文献
17.
《British journal of educational technology : journal of the Council for Educational Technology》2018,49(1):111-126
Social networking applications such as WhatsApp have been extensively used for language research; however, they have rarely been applied for language assessment purposes. To explore the efficiency of WhatsApp for assessment purposes, 30 Iranian English learners doing self‐ and peer‐assessments on WhatsApp are studied. The changes and the reasons for the changes in their attitudes towards the two assessment types are also investigated. In a multi‐phase study, the participants were trained on the new concepts of mobile‐assisted self‐ and peer‐assessments. They were also involved in the concurrent tasks of self‐ and peer‐assessments as well as think‐aloud protocols and filled out four attitude questionnaires before and after their involvement in the two assessment types. Finally, they were interviewed for the reasons of change(s) in their attitudes. The t‐test and think‐aloud results show that though the participants assigned different grades to themselves and their peers, this is not a procedural difference. The questionnaire results show that the participants generally adopted negative attitudes towards mobile‐assisted assessments after being involved in them. They also gave various reasons for the change(s) in their attitudes. The results can substantially contribute to the ongoing debates on the use of alternative assessments through mobile device applications. 相似文献
18.
Daniel Reinholz 《Assessment & Evaluation in Higher Education》2016,41(2):301-315
This paper advances a model describing how peer assessment supports self-assessment. Although prior research demonstrates that peer assessment promotes self-assessment, the connection between these two activities is underspecified. This model, the assessment cycle, draws from theories of self-assessment to elaborate how learning takes place through peer assessment. The model is applied to three activity structures described in the literature to analyse their potential to support learning by promoting self-assessment. Broadly speaking, the model can be used to understand learning that takes place in a variety of peer assessment activities: marking/grading, analysis, feedback, conferencing and revision. This approach contrasts most studies on peer assessment, which have focused on calibration of instructor and peer grades, rather than learning opportunities. 相似文献
19.
20.
Although the rubric has emerged as one of the most popular assessment tools in progressive educational programs, there is an unfortunate dearth of information in the literature quantifying the actual effectiveness of the rubric as an assessment tool in the hands of the students. This study focuses on the validity and reliability of the rubric as an assessment tool for student peer‐group evaluation in an effort to further explore the use and effectiveness of the rubric. A total of 1577 peer‐group ratings using a rubric for an oral presentation was used in this 3‐year study involving 107 college biology students. A quantitative analysis of the rubric used in this study shows that it is used consistently by both students and the instructor across the study years. Moreover, the rubric appears to be ‘gender neutral’ and the students' academic strength has no significant bearing on the way that they employ the rubric. A significant, one‐to‐one relationship (slope = 1.0) between the instructor's assessment and the students' rating is seen across all years using the rubric. A generalizability study yields estimates of inter‐rater reliability of moderate values across all years and allows for the estimation of variance components. Taken together, these data indicate that the general form and evaluative criteria of the rubric are clear and that the rubric is a useful assessment tool for peer‐group (and self‐) assessment by students. To our knowledge, these data provide the first statistical documentation of the validity and reliability of the rubric for student peer‐group assessment. 相似文献