共查询到20条相似文献，搜索用时 515 毫秒
1.
Sebastián G. Guzmán 《Assessment & Evaluation in Higher Education》2018,43(6):893-907
Group projects are widely used in higher education, but they can be problematic if all group members are given the same grade for a project to which they might not have contributed equally. Most scholars recommend addressing these problems by awarding individual grades, computing some kind of individual weighting factor (IWF) from peer and (sometimes) self-assessments, which is then multiplied by the group grade to generate an individual grade. Several variants of the IWF method have been proposed, sometimes with complex algorithms. However, theory suggests they are inaccurate and their accuracy has not been evaluated. This article uses Monte Carlo experiments to assess the accuracy of the original IWF method and variants proposed in the past decade. Findings show that the earlier, simpler methods work best and that self-assessments should definitely be avoided. 相似文献
2.
Jordan L. Neus 《Assessment & Evaluation in Higher Education》2011,36(3):301-314
Peer assessment has been gaining significant ground as a means of fostering an environment of accountability and responsibility for group projects in higher education. A popular peer assessment method assigns individual grades via a linear relationship to peer assessment scores. Using this method, a group member who receives his or her group’s average peer assessment score is assigned the instructor‐given group grade; the group member who receives a total peer assessment score of zero is assigned an individual grade of zero. Unfortunately, applying this method often requires time‐consuming exploratory data analysis because of the potential for the method to yield a high spread of grades, including grades over 100%. The present study proposes a modification, which accounts for the degree of student agreement. When the modified procedure results in a change from the group grade, the direction of change is always the same, but with smaller magnitude, requiring less subsequent data analysis and instructor time demands. Easy‐to‐modify SAS code for applying the method is presented in the Appendix. 相似文献
3.
Lan Li Xiongyi Liu Yuchun Zhou 《British journal of educational technology : journal of the Council for Educational Technology》2012,43(3):376-384
The study examined how playing two roles as assessors and assessees in technology‐assisted peer assessment contributes to students' performance. Data from a previous study was recoded and analysed to understand peer assessment processes from a different angle. Findings of our previous study supported the importance of the assessor's role, but not the assessee's role. In the present study, the assessee's role was re‐examined based on the assessee's ability to critically judge and act upon peer feedback, instead of quality of peer feedback that they received. Regression analysis was conducted, and results suggested that how students responded to peer feedback, as indicated by the number of good versus misleading suggestions incorporated, significantly predicted their final project scores. The findings support the importance of both assessor and assessee's roles in peer assessment and provide valuable implications for effective implementation of peer assessment. 相似文献
4.
Overcoming the potential dilemma of awarding the same grade to a group of students for group work assignments, regardless of the contribution made by each group member, is a problem facing teachers who ask their students to work collaboratively together on assessed group tasks. In this paper, we report on the procedures to factor in the contributions of individual group members engaged in an integrated group project using peer assessment procedures. Our findings demonstrate that the method we used resulted in a substantially wider spread of marks being given to individual students. Almost every student was awarded a numerical score which was higher or lower than a simple group project mark would have been. When these numerical scores were converted into the final letter grades, approximately one-third of the students received a grade for the group project that was different from the grade that they would have received if the same grade had been awarded to all group members. Based on these preliminary findings we conclude that peer assessment can be usefully and meaningfully employed to factor individual contributions into the grades awarded to students engaged in collaborative group work. 相似文献
5.
In this study, category‐based self and peer assessment were applied twice in a semester in an Elementary Science Teaching Methods course in order to assess individual contributions of group members to group projects as well as to analyze the impact of Individual Weighting Factors (IWF) on individual scores and individual grades. IWF were calculated by applying Conway et al.'s (1993) formula. The resulting individual scores were analyzed to find out the impact of IWF on individual scores and individual grades. It was found that the differentiation of individual scores was very large in both applications and caused dramatic changes in some of the students' grades. For this reason, the IWF had to be scaled down to decrease its effect on individual grades. After scaling down the IWF, more acceptable distribution of student grades was obtained. 相似文献
6.
The impact of two types of peer assessment on students' performance and satisfaction within a Wiki environment 总被引：1，自引：0，他引：1
The purpose of this study was to compare the effects of two peer assessment methods on university students' academic writing performance and their satisfaction with peer assessment. This study also examined the validity and reliability of student generated assessment scores. Two hundred and thirty-two predominantly undergraduate students were selected by convenience sampling during the fall semester of 2007. The results indicate that students in the experimental group demonstrated greater improvement in their writing than those in the comparison group, and the findings reveal that students in the experimental group exhibited higher levels of satisfaction with the peer assessment method both in peer assessment structure and peer feedback than those in the comparison group. Additionally, the findings indicate that the validity and reliability of student generated rating scores were extremely high. Using Wiki interactive software and providing an online collaborative learning environment to facilitate peer assessment added value to peer assessment. 相似文献
7.
This study examined the effects of identity revelation and concealment on the number of times students' work was assessed in an online peer assessment context. It also examined the underlying reasons guiding the assessor's targeting behavior. Two fifth-grade classes participated. The one-group pretest–posttest experimental research design coupled with qualitative research method was adopted. The results from social network analysis (SNA) showed a high redundancy rate for both high- and low-targeted assessees in identity-revealed and identity-concealed conditions for both classes. Moreover, the density metrics indicated that all sociograms were similarly sparse. The Wilcoxon tests further confirmed that there were no significant differences in the assessees' ranking in the two conditions for both classes. Finally, analysis of students' self-reflective data revealed that the features/content of the work to be assessed, rather than who the question-author was, was the determining factor when it came to deciding the target for online peer assessment. 相似文献
8.
This article traces one university's approaches of peer assessment to develop fair and reliable systems of mark distribution resulting from group projects and to adapt one model to the specific requirements of civil engineering. It is the result of a two and a half years' experience with peer assessment in classes of different combinations of size, entry qualifications and experience. Initially, the methods devised by Goldfinch & Raeside (1990) were used; the relevance and drawbacks of this two‐part method of assessment in the field of civil engineering are discussed and new ideas are proposed. That article had suggested that the model is transferable. It has proved to be the case and in this discipline, that project diaries which the tutor uses to allocate individuals a mark, offer a unique alternative to Part 1 of the assessment process. 相似文献
9.
10.
《The Internet and Higher Education》2010,13(3):164-169
Online peer assessment is an innovative evaluation method that has caught both educators' and practitioners' attention in recent years. The purpose of this study was to develop relevant questionnaires for teachers to understand student self-efficacy and motivation in online peer assessment learning environments. A total of 205 college students with experience in online peer assessment participated in this study. Two questionnaires measuring students' online peer assessment self-efficacy (OPASS) and their motivations in online peer assessment learning environments (MOPAS) were developed. The former included three self-efficacy scales: evaluating, receiving and reacting. The latter included two scales: intrinsic motivation and extrinsic motivation. Through factor analysis, both revealed highly satisfactory validity and reliability in assessing students' self-efficacy and motivation in online peer assessment learning environments. Moreover, the students' responses also showed that they were highly confident and strongly intrinsically motivated when participating in an online peer assessment learning environment. Finally, the interplay between the scales of OPASS and those of MOPAS was explored and the reciprocal relationship between students' self-efficacy and motivation in an online peer assessment learning environment was also highlighted. 相似文献
11.
One major challenge in using group projects to assess student learning is accounting for the differences of contribution among group members so that the mark assigned to each individual actually reflects their performance. This research addresses the validity of grading group projects by evaluating different methods that derive individualized scores from group work. Both Monte Carlo simulation and real test data analyses were conducted. The four investigated methods are the within-group adjustment method, the partial adjustment method, the between-group adjustment method, and the expected contribution adjustment method. For all methods, a weighting factor is computed based on the peer and self ratings of contributions to the group project by group members. This study finds that individual differences have to be taken into account if group grades are going to be assigned and utilized for evaluating individual performance at all. Adjusting contribution differences based on peer and self ratings could be an effective way to improve the validity of group grades. Among the four studied methods, adjusting both the within-group and between-group contribution differences is the most effective, and is thus recommended for classroom use. 相似文献
12.
13.
同伴评价作为一种评价方式已经被忽略多年。很多研究者与教师都对它的可靠性和有效性心存疑虑。作者在一次平时英语口语测试中,采用了学生评价的方式对学生进行考核,把学生给同伴所打分的平均值与教师所给分值进行对比。通过此定量研究,作者意在调查英语口语教学实践中同伴评价的信度和效度。统计数据显示,学生给同伴所打分的平均值与教师所给分值非常接近。这也验证了在这种情况下,同伴评价具有较高的信度和效度。作者还开展了一个小组讨论来调查学生对这种评价方式的认同感以及所担心的问题。此调查对于未来同伴评价的设计具有一定的参考价值。 相似文献
14.
Ciprian Spatar Henny Mills Vedrana Kutija Martin Cooke 《Assessment & Evaluation in Higher Education》2015,40(3):371-389
Group work can form a substantial component of degree programme assessments. To satisfy institutional and student expectations, students must often be assigned individual marks for their contributions to the group project, typically by mapping a single holistic group mark to individual marks using peer assessment scores. Since the early 1990s, various mapping methods that use self- and peer ratings have been developed. They are based on (normalised) individual weighting factors, partial scaling of the group mark, inter-rater agreement corrections or parabolic functions. We show that no single existing method can be successfully applied to most practical peer assessment scenarios such as different marking scale interpretations, intra-group ranking errors, biased free-riders and marks exceeding 100%. We present a combined analytical mapping method that incorporates the benefits of existing mechanisms, but alleviates their weaknesses with minimum computational effort and tutor input. The robustness of the method is illustrated through problematic assessment examples and empirically evaluated in multiple group work environments involving a total of 243 students and five different disciplines. 相似文献
15.
《The Internet and Higher Education》2010,13(4):242-247
This study used an online peer assessment activity to help 47 college students to learn biology through writing. Each student submitted a biology writing report to an online system and then experienced three rounds of peer assessment. During the online peer assessment process, self, peer and expert evaluation scores for the writing were gathered across three rounds. It was found that self-assessment scores were not quite consistent with the expert's scores, but the peer assessment scores demonstrated adequate validity with the expert's evaluation. In particular, when the students had more rounds of peer assessment for reviewing the writing, the validity of the peer scores was enhanced. An examination of the students' writing scores, allocated by peers and expert, indicated that the students significantly improved the writing as the peer assessment activity proceeded. Content analyses of the students' writing also revealed that their writing gradually developed with significantly better coverage, richness and organization resulting from the online peer assessment activity. 相似文献
16.
In recent years project-based learning (PBL) incorporating online discussions has gradually been applied to courses that focus on writing projects. Past studies have shown that learners in PBL often face the difficulties of not having in-depth data analysis and peer discussions and how teachers design the rules and methods for online discussions has a significant influence on the quality of discussion. Since using a peer assessment strategy in the classroom could facilitate learners' critical thinking and meta-cognitive skills, this study conducts an empirical observational study in order to analyse the content and process of the discussion activities based on peer assessment without teacher intervention and tries to explore students' knowledge construction of the discussion. Sequential analysis and content analysis were conducted to observe the scale of each aspect of knowledge construction and the sequential pattern of students' knowledge construction during the discussions. Teachers didn't provide any guidance or intervention during the activity. Based on the results of the observations, this study discusses the possible difficulties that students may encounter when conducting peer assessment online discussions. Finally, this study also proposes suggestions about the timing and methods for teacher interventions. 相似文献
17.
Ho Sung Kim 《European Journal of Engineering Education》2013,38(6):671-686
A quantitative method for estimating an expected uncertainty (reliability and validity) in assessment results arising from the relativity between four variables, viz examiner's expertise, examinee's expertise achieved, assessment task difficulty and examinee's performance, was developed for the complex assessment applicable to final year project thesis assessment including peer assessment. A guide map can be generated by the method for finding expected uncertainties prior to the assessment implementation with a given set of variables. It employs a scale for visualisation of expertise levels, derivation of which is based on quantified clarities of mental images for levels of the examiner's expertise and the examinee's expertise achieved. To identify the relevant expertise areas that depend on the complexity in assessment format, a graphical continuum model was developed. The continuum model consists of assessment task, assessment standards and criterion for the transition towards the complex assessment owing to the relativity between implicitness and explicitness and is capable of identifying areas of expertise required for scale development. 相似文献
18.
Although the rubric has emerged as one of the most popular assessment tools in progressive educational programs, there is an unfortunate dearth of information in the literature quantifying the actual effectiveness of the rubric as an assessment tool in the hands of the students. This study focuses on the validity and reliability of the rubric as an assessment tool for student peer‐group evaluation in an effort to further explore the use and effectiveness of the rubric. A total of 1577 peer‐group ratings using a rubric for an oral presentation was used in this 3‐year study involving 107 college biology students. A quantitative analysis of the rubric used in this study shows that it is used consistently by both students and the instructor across the study years. Moreover, the rubric appears to be ‘gender neutral’ and the students' academic strength has no significant bearing on the way that they employ the rubric. A significant, one‐to‐one relationship (slope = 1.0) between the instructor's assessment and the students' rating is seen across all years using the rubric. A generalizability study yields estimates of inter‐rater reliability of moderate values across all years and allows for the estimation of variance components. Taken together, these data indicate that the general form and evaluative criteria of the rubric are clear and that the rubric is a useful assessment tool for peer‐group (and self‐) assessment by students. To our knowledge, these data provide the first statistical documentation of the validity and reliability of the rubric for student peer‐group assessment. 相似文献
19.
Hongli Li Yao Xiong Xiaojiao Zang Mindy L. Kornhaber Youngsun Lyu Kyung Sun Chung 《Assessment & Evaluation in Higher Education》2016,41(2):245-264
Given the wide use of peer assessment, especially in higher education, the relative accuracy of peer ratings compared to teacher ratings is a major concern for both educators and researchers. This concern has grown with the increase of peer assessment in digital platforms. In this meta-analysis, using a variance-known hierarchical linear modelling approach, we synthesise findings from studies on peer assessment since 1999 when computer-assisted peer assessment started to proliferate. The estimated average Pearson correlation between peer and teacher ratings is found to be .63, which is moderately strong. This correlation is significantly higher when: (a) the peer assessment is paper-based rather than computer-assisted; (b) the subject area is not medical/clinical; (c) the course is graduate level rather than undergraduate or K-12; (d) individual work instead of group work is assessed; (e) the assessors and assessees are matched at random; (f) the peer assessment is voluntary instead of compulsory; (g) the peer assessment is non-anonymous; (h) peer raters provide both scores and qualitative comments instead of only scores; and (i) peer raters are involved in developing the rating criteria. The findings are expected to inform practitioners regarding peer assessment practices that are more likely to exhibit better agreement with teacher assessment. 相似文献
20.
Nancy Falchikov 《Assessment & Evaluation in Higher Education》1986,11(2):146-166
Any student assessment procedure should meet a number of criteria. It should be -valid, reliable, practicable and fair, and useful to students.(1) The prevailing authoritarian model of assessment in higher education is examined and its disadvantages elaborated. Results of some previous studies of self assessment are discussed. The present study attempts to meet Percival and Ellington's criteria, and addresses itself to a number of important questions concerning the comparability of self and peer group assessment with traditional methods; the extent of over‐ or undermarking by students, the relationships between accuracy of grading and age or overall ability, and the possible effects on learning or personal development of self and peer group assessment procedures. Details of the implementation of the scheme are recorded, and results presented and discussed. In terms of both product (the correspondences between self or peer and tutor assessment) and process (the evaluation by students of the effects of the scheme), the scheme appears to be successful. Implications and plans for future studies are elaborated. 相似文献