共查询到20条相似文献，搜索用时 31 毫秒
1.
Concerns relating to the reliability of teacher and student peer assessments are discussed, and some correlational analyses comparing student and teacher marks described. The benefits of the use of multiple ratings are elaborated. The distinction between gender differences and gender bias is drawn, and some studies which have reported gender bias are reviewed. The issue of ‘blind marking’ is addressed. A technique for detecting gender bias in cases where student raters have awarded marks to same and opposite sex peers is described, and illustrated by data from two case studies. Effect sizes were found to be very small, indicating an absence of gender bias in these two cases. Results are discussed in relation to task and other contextual variables. The authors conclude that the technique described can contribute to the good practice necessary to ensure the success of peer assessment in terms of pedagogical benefits and reliable and fair marking outcomes. 相似文献
2.
Differing levels of gender salience in preschool classrooms: effects on children's gender attitudes and intergroup bias 总被引：1，自引：0，他引：1
Developmental intergroup theory posits that when environments make social-group membership salient, children will be particularly likely to apply categorization processes to social groups, thereby increasing stereotypes and prejudices. To test the predicted impact of environmental gender salience, 3- to 5-year-old children (N = 57) completed gender attitude, intergroup bias, and personal preference measures at the beginning and end of a 2-week period during which teachers either did or did not make gender salient. Observations of peer play were also made at both times. After 2 weeks, children in the high- (but not low-) salience condition showed significantly increased gender stereotypes, less positive ratings of other-sex peers, and decreased play with other-sex peers. Children's own activity and occupational preferences, however, remained unaffected. 相似文献
3.
Chao Han 《Assessment & Evaluation in Higher Education》2018,43(6):979-994
Despite the increasing popularity of peer assessment in tertiary-level interpreter education, very little research has been conducted to examine the quality of peer ratings on language interpretation. While previous research on the quality of peer ratings, particularly rating accuracy, mainly relies on correlation and analysis of variance, latent trait modelling emerges as a useful approach to investigate rating accuracy in rater-mediated performance assessment. The present study demonstrates the use of multifaceted Rasch partial credit modelling to explore the accuracy of peer ratings on English-Chinese consecutive interpretation. The analysis shows that there was a relatively wide spread of rater accuracy estimates and that statistically significant differences were found between peer raters regarding rating accuracy. Additionally, it was easier for peer raters to assess some students accurately than others, to peer-assess target language quality accurately than the other rating domains, and to provide accurate ratings to English-to-Chinese interpretation than the other direction. Through these findings, latent trait modelling demonstrates its capability to produce individual-level indices, measure rater accuracy directly, and accommodate sparse data rating designs. It is therefore hoped that substantive inquiries into peer assessment of language interpretation could utilise latent trait modelling to move this line of research forward. 相似文献
4.
Barbara Crossouard 《British Educational Research Journal》2012,38(5):731-748
This article focuses on the discursive characteristics of peer assessment interactions, drawing upon recent research into formative assessment within a task design involving extended project‐based work tackled in groups by pupils. Case studies were conducted within two schools in socially deprived areas of Scotland. They included classroom observation, digital video and audio data collection, and a series of interviews with pupils and teachers. The task design created opportunities for interdisciplinary, collaborative learning and generated strong pupil engagement. However, a disjuncture is seen between the conflictual characteristics of peer assessment, which are suggested to have gendered and social class dimensions, and the discourses of teamwork and community‐building that were privileged in the classrooms observed. Although recognised more in research conversations, the article argues that teachers could be better supported in considering how social class and gender are implicated in peer assessment and in developing classroom discourse that addresses social equity issues. 相似文献
5.
Peer assessment is an educational arrangement where students judge a peer's performance quantitatively and/or qualitatively and which stimulates students to reflect, discuss and collaborate. However, empirical evidence for peer assessment effects on learning is scarce, mostly based on student self-reports or involving comparison of peers' and teachers' ratings or anecdotal evidence from case studies. Systematic investigation of learning effects necessitates methodological, functional, and conceptual development in peer assessment research. This implies sound (quasi-)experimental studies, the definition of specific peer assessment mechanisms, and affiliations with other research domains. The articles in this special issue address these three needs and offer new directions for research. 相似文献
6.
This study examines the impact of an assessment training module on student assessment skills and task performance in a technology-facilitated peer assessment. Seventy-eight undergraduate students participated in the study. The participants completed an assessment training exercise, prior to engaging in peer-assessment activities. During the training, students reviewed learning concepts, discussed marking criteria, graded example projects and compared their evaluations with the instructor’s evaluation. Data were collected in the form of initial and final versions of students’ projects, students’ scoring of example projects before and after the assessment training, and written feedback that students provided on peer projects. Results of data analysis indicate that the assessment training led to a significant decrease in the discrepancy between student ratings and instructor rating of example projects. In addition, the degree of student vs. instructor discrepancy was highly predictive of the quality of feedback that students provided to their peers and the effectiveness of revisions that they made to their own projects upon receiving peer feedback. Smaller discrepancies in ratings were associated with provision of higher quality peer feedback during peer assessment, as well as better revision of initial projects after peer assessment. 相似文献
7.
8.
Thomas O’Neill Nicole Larson Julia Smith Magda Donia Connie Deng William Rosehart 《Assessment & Evaluation in Higher Education》2019,44(6):848-862
In the current research, we report on a peer feedback system for supporting student teamwork skill development during post-secondary education. The peer feedback system is part of a larger suite of assessments at ITPmetrics.com. This is a free assessment-based system that allows team members to provide round-robin ratings of each member’s effectiveness in the team on five dimensions (communication; commitment; foundation of knowledge, skills and abilities; emphasising high standards; and focus), as well as provide anonymous written feedback to supplement the numeric scores. Team members have access to a dashboard where they can complete the assessment and store assessment reports generated from their peers’ ratings. We summarise data from student learning teams suggesting that peer ratings are reliable (internally consistent, unidimensional and inter-rater correlated; n?>?85,000). Recommendations for implementation are provided with respect to pre-briefing, debriefing, and assessment schedules. 相似文献
9.
The effects of gender on group work process and achievement: an analysis through self‐ and peer‐assessment 
下载免费PDF全文
下载免费PDF全文 The importance of teamwork skills as part of employability has been widely acknowledged and accompanied by active research on successful cooperative learning. However, relatively few studies have focused on the effects of gender on students' group work, and only a limited number of empirical studies exist that examine students' group work process and performance through the results of self‐ and peer‐assessment. This study examines the effects of gender on group work process and performance using the self‐ and peer‐assessment results of 1001 students in British higher education formed into 192 groups. The analysis aggregates all measures on the group level in order to examine the overall group performance. Further, a simple regression model is used to capture the effects of group gender compositions. Results suggest that students in gender balanced groups display enhanced collaboration in group work processes. The enhanced collaboration could be associated with less social loafing behaviours and more equitable contributions to the group work. However, the results imply that this cooperative learning environment does not lead to higher student performance. Students' comments allow us to explore possible reasons for this finding. The results also indicate underperformance by all‐male groups and reduced collaborative behaviours by solo males in male gender exception groups (i.e., groups consisting of one male student and other members being female). The results thus have implications for the composition of groups. The pedagogical implications of these findings are discussed. 相似文献
10.
Tracey Bowen 《高等教育研究与发展》2020,39(3):411-424
ABSTRACTWork-integrated learning (WIL) affords students opportunities to apply skills and knowledge to practical work placements. Students potentially learn professional behaviours appropriate to their chosen industry sector. However, students may also face challenges they may not be prepared to navigate. One of these is gender bias due to assumptions about women and work, particularly within STEM sectors. This article presents findings from a pilot study that explores WIL students’ perspectives on gender bias related to experiences at their internship placements or other jobs. The findings suggest that the potential lack of gender neutrality within organizations such as WIL placements, is nuanced through an underlying bias around thinking about gender, women and work, and demonstrated through institutional structures such as branded recruitment campaigns or the individual micro aggressions of co-workers and supervisors. Further research needs to focus on the impact of gender bias on students’ sense of value within different organizations, and the strategies they employ to navigate bias. In the short-term, all students need tools to help them understand how gender is constructed within organizational processes and how to develop strategies to help them confront gender bias within the organizations in which they work. 相似文献
11.
Hongli Li Yao Xiong Xiaojiao Zang Mindy L. Kornhaber Youngsun Lyu Kyung Sun Chung 《Assessment & Evaluation in Higher Education》2016,41(2):245-264
Given the wide use of peer assessment, especially in higher education, the relative accuracy of peer ratings compared to teacher ratings is a major concern for both educators and researchers. This concern has grown with the increase of peer assessment in digital platforms. In this meta-analysis, using a variance-known hierarchical linear modelling approach, we synthesise findings from studies on peer assessment since 1999 when computer-assisted peer assessment started to proliferate. The estimated average Pearson correlation between peer and teacher ratings is found to be .63, which is moderately strong. This correlation is significantly higher when: (a) the peer assessment is paper-based rather than computer-assisted; (b) the subject area is not medical/clinical; (c) the course is graduate level rather than undergraduate or K-12; (d) individual work instead of group work is assessed; (e) the assessors and assessees are matched at random; (f) the peer assessment is voluntary instead of compulsory; (g) the peer assessment is non-anonymous; (h) peer raters provide both scores and qualitative comments instead of only scores; and (i) peer raters are involved in developing the rating criteria. The findings are expected to inform practitioners regarding peer assessment practices that are more likely to exhibit better agreement with teacher assessment. 相似文献
12.
Abstract Peer assessment was introduced into the assessment strategy of two marketing modules on two undergraduate programmes at Manchester Metropolitan University. A questionnaire was used to elicit responses from a sample of 80 students concerning their attitudes to and experience of, the peer assessment exercise. Students felt that the benefits of peer assessment were: the increase in personal motivation as a result of their active involvement in the assessment process; the opportunity to compare and discuss the assignment, and the opportunity to gain knowledge and develop a greater understanding of the assignment content and assessment process. Criticisms included the effects of personal bias on the marks awarded, the interpretation of criteria and the ability of the students to assess. Some students regarded peer assessment as an incentive to perform, while others saw it as an unfair system that lacked objectivity. Over half the sample regarded assessment as solely a role for the tutor. The research found that peer assessment made a valuable contribution to the variety of assessment and it enabled students to better understand the assessment process, however, it was a time consuming process for tutors 相似文献
13.
One of the productive lines of research on self-assessment (SA) and peer assessment (PA) concerns their concurrent validity with respect to a criterion measure. However, similar research has rarely been conducted for spoken-language interpreting. This article therefore reports on a longitudinal study that investigated the validity of self and peer ratings on three performance dimensions of English-Chinese consecutive interpretation (i.e., information completeness, fluency of delivery, and target language quality), taking teachers’ ratings as a yardstick. Major findings include: although the students as a group were unable to replicate teachers’ ratings, they were able to rank-order their performances in a fairly accurate manner and improved their SA and PA accuracy over time. Interpreting directionality seems to moderate the correlational strength of self/teacher ratings and peer/teacher ratings. These results are discussed in relation to previous literature, and pedagogical suggestions are provided to improve SA and PA for bi-directional interpretation. 相似文献
14.
Lynette MacKenzie 《Assessment & Evaluation in Higher Education》2000,25(2):135-147
This study was undertaken in order to evaluate the use of students as peer assessors, in collaboration with academic tutors, in the assessment of second-year viva examinations as part of a problem based learning occupational therapy curriculum. Data were collected from three consecutive cohorts of second-year students (N = 93), and an assessment was made of the reliability of the academic tutor marking, and the reliability of peer marking against the tutor marks. Results demonstrated that overall ratings of the viva examination performances given by the panel of assessors (two peer assessors and one academic tutor), were significantly correlated. On some occasions, such as the assessment of a borderline student, the ratings given were not as closely correlated. Some modifications of the examination process are suggested in order to optimise the reliability of the outcomes, but the study results lend support for the practice of peer assessment. 相似文献
15.
Although the rubric has emerged as one of the most popular assessment tools in progressive educational programs, there is an unfortunate dearth of information in the literature quantifying the actual effectiveness of the rubric as an assessment tool in the hands of the students. This study focuses on the validity and reliability of the rubric as an assessment tool for student peer‐group evaluation in an effort to further explore the use and effectiveness of the rubric. A total of 1577 peer‐group ratings using a rubric for an oral presentation was used in this 3‐year study involving 107 college biology students. A quantitative analysis of the rubric used in this study shows that it is used consistently by both students and the instructor across the study years. Moreover, the rubric appears to be ‘gender neutral’ and the students' academic strength has no significant bearing on the way that they employ the rubric. A significant, one‐to‐one relationship (slope = 1.0) between the instructor's assessment and the students' rating is seen across all years using the rubric. A generalizability study yields estimates of inter‐rater reliability of moderate values across all years and allows for the estimation of variance components. Taken together, these data indicate that the general form and evaluative criteria of the rubric are clear and that the rubric is a useful assessment tool for peer‐group (and self‐) assessment by students. To our knowledge, these data provide the first statistical documentation of the validity and reliability of the rubric for student peer‐group assessment. 相似文献
16.
17.
AbstractThe validity of traditional opinion-based student evaluations of teaching (SETs) may be compromised by inattentive responses and low response rates due to evaluation fatigue, and/or by personal response bias. To reduce the impact of evaluation fatigue and personal response bias on SETs, this study explores peer prediction-based SETs as an alternative to opinion-based SETs in a multicultural environment. The results suggest that statistically significant fewer respondents are needed to reach stable average outcomes when peer prediction-based SETs are used than when opinion-based SETs are used. This implies that peer prediction-based SETs could reduce evaluation fatigue, as not all students would need to do each evaluation. The results also report that the peer prediction-based method significantly reduces the bias evident in the opinion-based method, in respect of gender and prior academic performance. However, in respect of the cultural variables, race and home language, bias was identified in the peer prediction-based method, where none was evident in the opinion-based method. These observations, interpreted through the psychology literature on the formulation of perceptions of others, imply that although peer prediction-based SETs may in some instances reduce some personal response bias, it may introduce the perceived bias of others. 相似文献
18.
Marion Porath 《International journal for the advancement of counseling》1998,20(4):289-299
Gender differences in young highly able children's psychosocial development were investigated using child and teacher ratings of prosocial behavior and peer acceptance. Developmental patterns were addressed by studying two groups – children in the primary grades (1 and 2) and children in grades 3 to 7. No gender differences were found on teacher or child ratings in the younger group. In the older group, gender differences favoring girls were found on teacher ratings of prosocial behavior and peer acceptance. Comparisons of child and teacher ratings by gender showed that the older boys viewed themselves as demonstrating more social skills and as being more accepted by peers than their teachers did. Implications for education and counselling are discussed. 相似文献
19.
Geetha B. Nambissan 《Changing English: An International Journal of English Teaching》2005,12(2):191-199
This paper focuses on the education of girl children in India. It attempts to understand how gender identity influences the quality of their learning experiences. Reviewing available studies it explores how gender is contextualized within schools and pervades classroom processes, specifically in relation to ‘official’ school knowledge as well as the hidden curriculum of teacher attitudes and peer interaction. It points to the need for a gender perspective to inform school policy and classroom practices and also be integrated in teacher education. It suggests that unless gender concerns are seriously addressed, the number of girls who enrol in schools may increase, but they are unlikely to receive an education that is equitable. 相似文献
20.
Benjamin A. Mason Adalet Baris Gunersel Emilie A. Ney 《Psychology in the schools》2014,51(10):1017-1030
Behavior rating scales are indirect measures of emotional and social functioning used for assessment purposes. Rater bias is systematic error that may compromise the validity of behavior rating scale scores. Teacher bias in ratings of behavior has been investigated in multiple studies, but not yet assessed in a research synthesis that focuses on the role of ethnicity and culture. Teacher bias in ratings of student behavior was investigated through a comprehensive literature review that only included studies with a defensible criterion of true behavior against which to compare rating scores. A final total of 13 studies of teacher bias suggested mixed evidence for bias due to student ethnicity and strong evidence of bias due to teacher culture, particularly when positive stereotypes were violated. Limitations and future directions of research are discussed. 相似文献