共查询到20条相似文献，搜索用时 15 毫秒
1.
The participation of students in assessment is known to generate higher-order learning outcomes. This study aims to determine the usefulness of rubrics in aiding the incorporation of undergraduate students into assessor teams for developing their professional judgement. A quasi-experimental study examined the effects of a brief training programme on the use of rubrics, and of the participation of students in rubric creation and moderation discussions. We calculated Cronbach’s alphas, and intraclass correlation coefficients in order to examine the intra- and inter-rater reliability between all the members of the assessor teams. The results demonstrate that only participation in the rubric design and in the moderation discussions regulating their use helped undergraduate students to develop sound assessment skills. We infer that rubrics can help to promote professional judgement if they are conceived as instructional resources for defining and supporting the processes of negotiation and agreement that characterize an assessment culture. 相似文献
2.
A review of rubric use in higher education 总被引：5，自引：3，他引：2
This paper critically reviews the empirical research on the use of rubrics at the post‐secondary level, identifies gaps in the literature and proposes areas in need of research. Studies of rubrics in higher education have been undertaken in a wide range of disciplines and for multiple purposes, including increasing student achievement, improving instruction and evaluating programmes. While, student perceptions of rubrics are generally positive and some authors report positive responses to rubric use by instructors, others noted a tendency for instructors to resist using them. Two studies suggested that rubric use was associated with improved academic performance, while one did not. The potential of rubrics to identify the need for improvements in courses and programmes has been demonstrated. Studies of the validity of rubrics have shown that clarity and appropriateness of language is a central concern. Studies of rater reliability tend to show that rubrics can lead to a relatively common interpretation of student performance. Suggestions for future research include the use of more rigorous research methods, more attention to validity and reliability, a closer focus on learning and research on rubric use in diverse educational contexts. 相似文献
3.
4.
This experimental project investigated the reliability and validity of rubrics in assessment of students’ written responses to a social science “writing prompt”. The participants were asked to grade one of the two samples of writing assuming it was written by a graduate student. In fact both samples were prepared by the authors. The first sample was well written in terms of sentence structure, spelling, grammar, and punctuation; however, the author did not fully answer the question. The second sample fully answered each part of the question, but included multiple errors in structure, spelling, grammar and punctuation. In the first experiment, the first sample was assessed by participants once without a rubric and once with a rubric. In the second experiment, the second sample was assessed by participants once without a rubric and once with a rubric. The results showed that raters were significantly influenced by mechanical characteristics of students’ writing rather than the content even when they used a rubric. Study results also indicated that using rubrics may not improve the reliability or validity of assessment if raters are not well trained on how to design and employ them effectively. 相似文献
5.
Peter Kilgour Maria Northcote Anthony Williams Andrew Kilgour 《Assessment & Evaluation in Higher Education》2020,45(1):140-153
AbstractThe use of assessment rubrics in the higher education sector is now widespread in a number of disciplines. Typically, these rubrics are constructed by teachers who also tend to be the main users of the rubrics throughout the grading process. In recent years, questions have been raised about this teacher-directed approach and some educators have begun to explore an alternate approach to rubric construction; that is, engaging students in collaboration with their teachers to co-construct assessment rubrics. This paper outlines the processes employed in a project that investigated the co-construction of rubrics within six different contexts. The project aimed to engage students in collaboration with their teachers to co-construct rubrics which are co-owned by teacher and student. A mixed methods approach was utilized to explore the effectiveness of the strategy. Questionnaires, interviews and focus groups were utilized to gather data from both the teacher-participants and student-participants regarding their experiences of being involved in the study. Findings are presented from the perspectives of both students and teachers, relating their views of rubrics and the activity of rubric co-construction. The paper concludes with recommendations for practical approaches to rubric co-construction and future research directions. 相似文献
6.
《Africa Education Review》2013,10(3):415-428
ABSTRACTThe assessment rubric is increasingly gaining recognition as a valuable tool in teaching and learning in higher education. While many studies have examined the value of rubrics for students, research into the lecturers’ usage of rubrics is limited. This article explores the lecturers’ perceptions of rubrics, in particular, its use and design, the role it can play in informing one's teaching practice and in curriculum review and development. The data shows that many lecturers use the rubric in a very mechanical and unconscious manner and view it mostly as a grading tool with limited instructional value. While acknowledging the rubric as a reflective tool for students, lecturers do not perceive it as having the same benefits for them. The findings, therefore suggest more conversations around the role that rubrics can play in informing one's teaching practice and course design. It also suggests further research into this area. 相似文献
7.
In response to the demand for sound science assessments, this article presents the development of a latent construct called knowledge integration as an effective measure of science inquiry. Knowledge integration assessments ask students to link, distinguish, evaluate, and organize their ideas about complex scientific topics. The article focuses on assessment topics commonly taught in 6th- through 12th-grade classes. Items from both published standardized tests and previous knowledge integration research were examined in 6 subject-area tests. Results from Rasch partial credit analyses revealed that the tests exhibited satisfactory psychometric properties with respect to internal consistency, item fit, weighted likelihood estimates, discrimination, and differential item functioning. Compared with items coded using dichotomous scoring rubrics, those coded with the knowledge integration rubrics yielded significantly higher discrimination indexes. The knowledge integration assessment tasks, analyzed using knowledge integration scoring rubrics, demonstrate strong promise as effective measures of complex science reasoning in varied science domains. 相似文献
8.
Teachers' use of rubrics to score non‐traditional tasks: factors related to discrepancies in scoring
Sherry L. Meier Beverly S. Rich JoAnn Cady 《Assessment in Education: Principles, Policy & Practice》2006,13(1):69-95
This study considered middle school mathematics teachers’ use of rubrics to score non‐traditional tasks. A group of eighth‐grade teachers attended a two‐day workshop where they evaluated assessment tasks and discussed the use an associated scoring rubric. Scored samples of student work submitted by the teachers indicated that they had difficulty using the rubrics for scoring. When compared to expert ratings, all except one teacher had discrepancies in scoring and some discrepancies indicated major problems. These discrepancies appear to be related to whether the task contained familiar or unfamiliar content and the mix of procedure and explanation the task required. Several other factors related to discrepancies, such as leniency errors, teacher knowledge, and the halo effect are also discussed. With the expanded use of rubrics in many arenas, these results show the need for more professional development related to rubric use. 相似文献
9.
Knowledge Rajohane Matshedisho 《Assessment & Evaluation in Higher Education》2020,45(2):169-179
AbstractAssessment rubrics intend to make criteria explicit to students. However, an understanding of assessment criteria requires tacit knowledge about which students may not be aware. The lack of such knowledge is notable in undergraduate health science students taking a compulsory course in the social sciences. This study performed a content analysis of how 1st year health sciences students interpret a SOLO assessment rubric for a sociology ‘reflection piece’ essay. The findings suggest that empiricism, standardisation and lack of tacit knowledge limit students’ ways of reasoning about the rubric. These limitations manifest in a methodical difference between students’ expectations and lecturers’ intentions of using a rubric. This difference is illustrated by the students’ need for procedural knowledge and the lecturer’s expectation of conceptual knowledge. These differences have implications for teaching, learning and assessment in health sciences undergraduate education. The findings also justify a dialogical approach to assessments through facilitating students’ epistemological development. 相似文献
10.
Standards-based assessment rubrics are recognised as an important tool for ensuring clear criteria in higher education. Most of the available evidence on rubrics comes from studies with face-to-face undergraduate students. Our study evaluated the introduction of rubrics into a postgraduate subject that included both online and face-to-face students. We conducted formative evaluation with former students to develop the rubrics, as well as surveying current students for process and impact evaluation, supplemented with a focus group. Process results showed that the rubrics were used widely and were generally considered to be of at least some use. Clarity of the rubrics was the main issue affecting perceived usefulness, particularly for the assessment tasks that had undergone comparatively less formative evaluation. Impact evaluation showed mixed results, with students that reported always using rubrics having higher marks on average compared to students who did not always use the rubrics. However, an expected improvement in marks across the whole student cohort compared to previous years did not eventuate, although this could be explained by a number of factors independent of the rubrics. Our results provide some evidence for the use of rubrics in postgraduate and online settings but highlight the need for rigorous formative evaluation. 相似文献
11.
The aim of this study was to compare the effects of co-creating rubrics against just using rubrics. By co-creating rubrics, the students might have the opportunity to better internalize them and have a voice in the assessment criteria. Two groups undertaking a degree in Sport Sciences (N = 65) participated. Results showed that the students who co-created the rubrics had higher levels of learning self-regulation measured through thinking aloud protocols, whereas the results from the self-reported self-regulation and self-efficacy questionnaires did not show significant differences. The treatment group outperformed the control group in only one out of the three tasks assessed. Regarding the perceptions about rubrics use, there were no significant differences except for the process of co-creation, to which the co-created rubric group gave higher importance. Therefore, this study has opened an interesting venue on rubrics research: co-creating rubrics may influence students’ activation of learning strategies. 相似文献
12.
作为全球第二个实现高等教育普及化的高等教育强国,加拿大高校学生学习成果评估体系富有特色:在评估内容方面,构建起了高等教育系统、院校以及学科(专业)等不同层面的学生学习成果体系;在评估方法方面,形成了由标准化测试、评价量规、表现性评估以及问卷调查等四种类型构成的多元化学生学习成果评估方法体系。其对我国的启示是:构建和完善高校学生学习成果评估的内容体系,为学生学习成果评估奠定共识基础;开发多元化的学生学习成果评估方法与工具,提高评估活动的科学性;加强以结果为导向的评估制度建设,促使学习成果评估常态化。 相似文献
13.
ABSTRACTAs an alternative to rubric scoring, comparative judgment generates essay scores by aggregating decisions about the relative quality of the essays. Comparative judgment eliminates certain scorer biases and potentially reduces training requirements, thereby allowing a large number of judges, including teachers, to participate in essay evaluation. The purpose of this study was to assess the validity, labor costs, and efficiency of comparative judgments as a potential substitute for rubric scoring. An analysis of two essay prompts revealed that comparative judgment measures were comparable to rubric scores at a level similar to that expected of two professional scorers. The comparative judgment measures correlated slightly higher than rubric scores with a multiple-choice writing test. Score reliability exceeding .80 was achieved with approximately nine judgments per response. The average judgment time was 94 seconds, which compared favorably to 119 seconds per rubric score. Practical challenges to future implementation are discussed. 相似文献
14.
ABSTRACTRubrics can guide teachers to provide effective feedback and students’ peer- and self-assessment. This paper examines the effect of rubric use in flipped learning activities on students’ learning achievement, metacognitive awareness, and cognitive load through a quasi-experiment. A total of 83 university students were randomly assigned to an experimental group or a control group. The students in the experimental group were given rubrics in performing pre-class learning activities on the cloud platform, while those in the control group used rubrics in post-class assessment and modification of their finished works. The results show that rubric use can assist flipped learning by improving students’ learning achievement and metacognitive awareness, while reducing their cognitive load. Using rubrics before in-class work can yield stronger benefits in raising metacognitive awareness and lessening cognitive load. Moreover, the study reveals that students tend to hold a generally favorable attitude toward rubric use. These findings imply that appropriate use of rubrics in flipped learning has the potential to create a more efficient and learner-friendly condition to enhance self-regulated learning. 相似文献
15.
Although the rubric has emerged as one of the most popular assessment tools in progressive educational programs, there is an unfortunate dearth of information in the literature quantifying the actual effectiveness of the rubric as an assessment tool in the hands of the students. This study focuses on the validity and reliability of the rubric as an assessment tool for student peer‐group evaluation in an effort to further explore the use and effectiveness of the rubric. A total of 1577 peer‐group ratings using a rubric for an oral presentation was used in this 3‐year study involving 107 college biology students. A quantitative analysis of the rubric used in this study shows that it is used consistently by both students and the instructor across the study years. Moreover, the rubric appears to be ‘gender neutral’ and the students' academic strength has no significant bearing on the way that they employ the rubric. A significant, one‐to‐one relationship (slope = 1.0) between the instructor's assessment and the students' rating is seen across all years using the rubric. A generalizability study yields estimates of inter‐rater reliability of moderate values across all years and allows for the estimation of variance components. Taken together, these data indicate that the general form and evaluative criteria of the rubric are clear and that the rubric is a useful assessment tool for peer‐group (and self‐) assessment by students. To our knowledge, these data provide the first statistical documentation of the validity and reliability of the rubric for student peer‐group assessment. 相似文献
16.
Linda Anglin Kenneth Anglin Paul L. Schumann John A. Kaliski 《Decision Sciences Journal of Innovative Education》2008,6(1):51-73
This study tests the use of computer‐assisted grading rubrics compared to other grading methods with respect to the efficiency and effectiveness of different grading processes for subjective assignments. The test was performed on a large Introduction to Business course. The students in this course were randomly assigned to four treatment groups based on the grading method. Efficiency was measured by the professor's time to grade the assignments; effectiveness was measured by a student satisfaction survey. Results suggest that the computer‐assisted grading rubrics were almost 200% faster than traditional hand grading without rubrics, more than 300% faster than hand grading with rubrics, and nearly 350% faster than typing the feedback into a Learning Content Management System. Results also seemed to indicate that the use of a computer‐assisted grading rubric did not negatively affect student attitudes concerning the helpfulness of their feedback, their satisfaction with the speed with which they received their feedback, or their satisfaction with the method by which they received feedback. 相似文献
17.
真实性评价迎合了当代高职教育人才培养改革和发展的需要.真实性评价中的"真实",是要求在课程学习成果评价的任务、能力、产出、标准四个要素上同时体现真实性,是对高职能力本位教学实践的补充与衔接.通过与职场现实工作情境及评价操作的参照比对,构建高职课程真实性评价设计模型,按照评价设计过程分为六个环节:能力要求、评价任务、任务条件、学生成果、评分规则、评分情境,并在真实性评价体系设计中融入对评价信度和效度的考量,以期促进真实性评价在教学实践中的应用. 相似文献
18.
Luis R. Murillo-Zamorano Manuel Montanero 《Assessment & Evaluation in Higher Education》2018,43(1):138-150
In this paper the authors analyse the competency of a sample of economics and business students in orally presenting academic content, as well as the changes that occurred after receiving feedback. The students’ presentations were videotaped, and a total of 96 were analysed at three stages: pre-test, post-test and follow-up. The participants were divided into two groups. In one, each student received feedback from a peer as part of a peer assessment with rubric activity. In the other, they received feedback from the teacher immediately after their presentation. In the post-test, the peer assessment with rubric students improved by 10% in the valuation of their presentation, while the teacher feedback students only improved by 5%. These results support the idea that undergraduates’ evaluations of their peers can be effective in improving oral presentation skills, especially when they are provided with some support instruments (videos and rubrics). However, the improvements in the peer assessment with rubric group were not maintained in the follow-up re-test. This suggests that a single session of peer assessment with rubric is insufficient to generalise any improvements in the said competency. The implications of these results with regard to the implementation of methods of formative peer assessment in higher education are discussed. 相似文献
19.
This work systematically reviews teacher assessment literacy measures within the context of contemporary teacher evaluation policy. In this study, the researchers collected objective tests of assessment knowledge, teacher self‐reports, and rubrics to evaluate teachers’ work in assessment literacy studies from 1991 to 2012. Then they evaluated the psychometric work from these measures against a set of claims related to score interpretation and use. Across the 36 measures reviewed, they found support for these claims was weak. This outcome highlights the need for increased work on assessment literacy measures in the educational measurement field. The authors conclude with recommendations and a resource to inform a research agenda focused on assessment literacy measurement to inform policy and practice. 相似文献
20.
Several benefits of using scoring rubrics in performance assessments have been proposed, such as increased consistency of scoring, the possibility to facilitate valid judgment of complex competencies, and promotion of learning. This paper investigates whether evidence for these claims can be found in the research literature. Several databases were searched for empirical research on rubrics, resulting in a total of 75 studies relevant for this review. Conclusions are that: (1) the reliable scoring of performance assessments can be enhanced by the use of rubrics, especially if they are analytic, topic-specific, and complemented with exemplars and/or rater training; (2) rubrics do not facilitate valid judgment of performance assessments per se. However, valid assessment could be facilitated by using a more comprehensive framework of validity when validating the rubric; (3) rubrics seem to have the potential of promoting learning and/or improve instruction. The main reason for this potential lies in the fact that rubrics make expectations and criteria explicit, which also facilitates feedback and self-assessment. 相似文献