首页 | 本学科首页   官方微博 | 高级检索  
相似文献
 共查询到20条相似文献，搜索用时 843 毫秒
1.
We report one teacher’s response to a top-down shift from external examinations to internal teacher assessment for summative purposes in the Republic of Ireland. The teacher adopted a comparative judgement approach to the assessment of secondary students’ understanding of a chemistry experiment. The aims of the research were to investigate whether comparative judgement can produce assessment outcomes that are valid and reliable without producing undue workload for the teachers involved. Comparative judgement outcomes correlated as expected both with test marks and with existing student achievement data, supporting the validity of the approach. Further analysis suggested that teacher judgement privileged scientific understanding, whereas marking privileged factual recall. The estimated reliability of the outcome was acceptably high, but comparative judgement was notably more time-consuming than marking. We consider how validity and efficiency might be improved and the contributions that comparative judgement might offer to summative assessment, moderation of teacher assessment and peer assessment.  相似文献   

2.
Student portfolios are increasingly used for assessing student competences in higher education, but results about the construct validity of portfolio assessment are mixed. A prerequisite for construct validity is that the portfolio assessment is based on relevant portfolio content. Assessment criteria, are often used to enhance this condition. This study aims to identify whether assessment criteria can improve content, argumentation and communication during teacher moderation while judging student portfolios. Six teachers scored 32 student portfolios in dyads with and without assessment criteria. Their judgement processes were qualitatively analysed. Results indicated that the quality of their judgement processes was low, since teachers based their judgements mainly on their own personal opinion and less on evidence found in the portfolio. Teachers barely paid attention to quality checks and easily agreed with each other. When teachers used assessment criteria, the quality of their judgements slightly improved. They based their judgements more on relevant evidence, used less personal experiences and more often checked the quality of their judgement processes. It is concluded that the quality of teacher portfolio judgement is low, and that the use of assessment criteria can enhance its quality.  相似文献   

3.
Major curriculum and assessment reforms in Australia have generated research interest in issues related to standards, teacher judgement and moderation. This article is based on one related inquiry of a large‐scale Australian Research Council Linkage project conducted in Queensland. This qualitative study analysed interview data to identify teachers’ views on standards and moderation as a means to achieving consistency of teacher judgement. A complementary aspect of the research involved a blind review that was conducted to determine the degree of teacher consistency without the experience of moderation. Empirical evidence was gained that most teachers, of the total interviewed, articulated a positive attitude towards the use of standards in moderation and perceived that this process produces consistency in teachers’ judgements. Context was identified as an important influential factor in teachers’ judgements and it was concluded that teachers’ assessment beliefs, attitudes and practices impact on their perceptions of the value of moderation practice and the extent to which consistency can be achieved.  相似文献   

4.
In the continuing concern about academic standards in the higher education sector a great deal of emphasis has been placed on quality assurance procedures rather than on considering how university tutors learn to grade the quality of work produced by students. As part of a larger research project focused on how tutors grade student coursework, this paper offers a new metaphor for such tutor learning, based on a sociocultural perspective. The research project used think‐aloud protocols recorded as university tutors graded student coursework, and this was followed by semi‐structured interviews. The voluntary participants consisted of 25 lecturers in four contrasting domains—humanities, art and design, medicine and teacher education—in three universities, two teaching‐led and one research intensive. We developed a metaphorical framework that helps to understand the work and learning of the lecturers and tested it by applying it to analysis of the tutor interview data. Grading, writing feedback, second marking and moderation are important situated professional learning opportunities for tutors to debate and reach agreement on the academic standard demonstrated by student coursework. The metaphor considers professional learning as interplay between the vertical domain of public knowledge and the horizontal domain of teachers' practical wisdom. The metaphor presented in this paper is proposed for critical consideration and wider use by academics, teachers, academic developers and teacher educators as an aid to better understanding of teacher's professional learning.  相似文献   

5.
Moderation is a quality assurance process that plays a central role in the teaching, learning, and assessment cycle in higher education. While there is a growing body of research globally on teaching, learning, and, to a lesser degree, assessment in higher education, the process of moderation of assessment has received even less attention. In a context of heightened accountability and greater transparency in the tertiary sector, the formalising of moderation processes has not been a part of established practice. In light of these changes, the purpose of this qualitative study was to identify and investigate current marking and moderation processes and practices operating within one faculty in a large urban university in eastern Australia to gain insight into the challenges to effective moderation. The findings suggest the need for moderation to be considered holistically as an inherent part of teaching and learning, and the need for ongoing staff development.  相似文献   

6.
Quality assurance is a major agenda in tertiary education. The casualisation of academic work, especially in teaching, is also a quality assurance issue. Casual or sessional staff members teach and assess more than 50% of all university courses in Australia, and yet the research in relation to the role sessional staff play in quality assurance of student assessment outcomes is scarce. Moderation processes are a pivotal part of robust quality assurance measures. Drawing upon previous work surrounding four discourses of moderation, this pilot project reports the results of research into the role and impact of sessional staff in moderation processes at tertiary level. Qualitative data were gathered through focus interviews. Results, in the form of various moderation discourses, indicate that sessional staff impact the formal quality assurance processes in numerous ways.  相似文献   

7.
There is a strong quest in several countries including Australia for greater national consistency in education and intensifying interest in standards for reporting. Given this, it is important to make explicit the intended and unintended consequences of assessment reform strategies and the pressures to pervert and conform. In a policy context that values standardisation, the great danger is that the technical, rationalist approaches that generalise and make superficial assessment practices, will emerge. In this article, the authors contend that the centrality and complexity of teacher judgement practice in such a policy context need to be understood. To this end, we discuss and analyse recorded talk in teacher moderation meetings showing the processes that teachers use as they work with stated standards to award grades (A to E). We show how they move to and fro between (1) supplied textual artefacts, including stated standards and samples of student responses, (2) tacit knowledge of different types, drawing into the moderation, and (3) social processes of dialogue and negotiation. While the stated standards play a part in judgement processes, in and of themselves they are shown to be insufficient to account for how the teachers ascribe value and award a grade to student work in moderation. At issue is the nature of judgement as cognitive and social practice in moderation and the legitimacy (or otherwise) of the mix of factors that shape how judgement occurs.  相似文献   

8.
The increasing interest in electronic management of assessment is a sign of a gradual institutionalisation of e‐submission and e‐marking technologies in UK Higher Education. The effective adoption of these technologies requires a managed approach, especially a detailed understanding of current assessment practices within the institution and the development of new or adapted business processes. The findings from close participant observation of assessment processes over a 2‐year period across a large Faculty reveal that three independent variables around (1) initial marking, (2) internal quality assurance and (3) the timing of the return of e‐feedback to students, determine variance in grading journeys. Despite the apparent wide variety of processes, five major grading journeys prevail: three varieties of moderation (moderation of multiple markers and moderation of single markers either before or after grades and feedback are released to students); and two forms of second marking (either blind or open to peers). Within an institution, the identification of major workflows is fundamental to both an effective implementation of assessment technologies and in conducting change. The identification of major workflows across UK Higher Education Institutions remains critical to attain the necessary software development from global vendors.  相似文献   

9.
While externally moderated standards-based assessment has been practised in Queensland senior schooling for more than three decades, there has been no such practice in the middle years. With the introduction of standards at state and national levels in these years, teacher judgement as developed in moderation practices is now vital. This paper argues, that in this context of assessment reform, standards intended to inform teacher judgement and to build assessment capacity are necessary but not sufficient for maintaining teacher and public confidence in schooling. Teacher judgement is intrinsic to moderation, and to professional practice, and can no longer remain private. Moderation too is intrinsic to efforts by the profession to realise judgements that are defensible, dependable and open to scrutiny. Moderation can no longer be considered an optional extra and requires system-level support especially if, as intended, the standards are linked to system-wide efforts to improve student learning. In presenting this argument we draw on an Australian Research Council funded study with key industry partners (the Queensland Studies Authority and the National Council for Curriculum and Assessment of the Republic of Ireland). The data analysed included teacher interview data and additional teacher talk during moderation sessions. These were undertaken during the initial phase of policy development. The analysis identified those issues that emerge in moderation meetings that are designed to reach consistent, reliable judgements. Of interest are the different ways in which teachers talked through and interacted with one another to reach agreement about the quality of student work in the application of standards. There is evidence of differences in the way that teachers made compensations and trade-offs in their award of grades, dependent on the subject domain in which they teach. This article concludes with some empirically derived insights into moderation practices aspolicy andsocial events.  相似文献   

10.
Reliable, consistent assessment process that produces comparable assessment grades between assessors and institutions is a core activity and an ongoing challenge with which universities have failed to come to terms. In this paper, we report results from an experiment that tests the impact of an intervention designed to reduce grader variability and develop a shared understanding of national threshold learning standards by a cohort of reviewers. The intervention involved consensus moderation of samples of accounting students’ work, with a focus on three research questions. First, what is the quantifiable difference in grader variability on the assessment of learning outcomes in ‘application skills’ and ‘judgement’? Second, does participation in the workshops lead to reduced disparity in the assessment of the students’ learning outcomes in ‘application skills’ and ‘judgement’? Third, does participation in the workshops lead to greater confidence by reviewers in their ability to assess students’ skills in application skills and judgement? Our findings suggest consensus moderation does reduce variability across graders and also builds grader confidence.  相似文献   

11.
There has been a threefold increase in the employment of casual academics in Australian universities within the last 20 years, to the extent that most teaching and marking is now undertaken by casual academics, also known as sessional staff. Yet, casualised teaching and assessment has been considered a risk to student engagement and success, and casual academics report a lack of professional development and increased feelings of marginalisation within the academy. Concurrently, the quality assurance of teaching and assessment in higher education has become a central focus of the government-funded regulatory organisation, the Tertiary Education Quality and Standards Agency (TEQSA). Situated within this context, we report on an assessment moderation process that could support casual academics’ contextualised professional development, generate a sense of connectedness and collegiality and fulfil the requirements of TEQSA. Such processes may ensure that workforce growth in the higher education system supports a robust quality assurance and regulatory framework.  相似文献   

12.
Assessing Pupils’ Progress (APP) arose from a government drive to increase the amount of teacher-based assessment within school and to make this consistent across schools. We conducted semi-structured interviews with head teachers to gain insight into how their schools applied APP and we compared the APP levels for English and Maths, provided by teachers across 11 schools for 72 pupils, to a standardised assessment (Wechsler Individual Achievement Test-II; WIAT). There was a strong correlation between the APP and WIAT for literacy but not for numeracy. Head teacher interviews revealed that APP is used differently across schools and at times is used in a way inconsistent with government guidance, which raises the question of how teacher assessments are used and their purpose. Questions that should be considered are; how is moderation used in schools, what is the function(s) of teacher assessments and what is good practice in relation to these assessments? Clarity about the function of assessments is of vital importance as is ensuring that assessments are meaningful to teachers, pupils, families and schools, especially in light of the weight that can be placed on teacher assessments for all these groups.  相似文献   

13.
The aim of the reported study was to explore how science teachers made sense of their roles and responsibilities in teaching and assessing science coursework. The focus was on the teacher assessment, the feedback that teachers gave to students and, how they perceived their role when they taught and assessed students’ science coursework reports. The research methodology included observation of science lessons, collection of marked students’ reports and two interviews with each of the nine participant teachers. Two cases of teachers are considered as representative of the participant teachers and their perceptions and practices are compared and contrasted. Teachers either adopted the role of the examiner or combined the role of the teacher with that of examiner. They distinguished marking of science theory exercises from marking of coursework and, teaching theory from teaching investigations, on the basis that the grade they assigned to coursework contributed to the total grade for external exams. A key conclusion is that teaching and assessment of science coursework need to re-focus on learning. The study calls for changes in public policy for summative assessment to place more reliance on teachers’ assessments and secondly, for changes in school practices in formative assessment for teachers to support students to learn in the case of science coursework.  相似文献   

14.
ABSTRACT

Feedback is an essential formative assessment practice that has the potential to influence student learning and achievement positively. Providing effective feedback, however, is a challenging task for teachers. Especially beginning teachers struggle with the provision of information that supports students in developing and improving their competences. Learning to provide feedback thus is an important aspect of teacher education. The present exploratory study investigates pre-service chemistry teachers’ practices regarding the judgement of students’ level of achievement and the provision of feedback in the context of the control-of-variables strategy. A sample of N?=?40 bachelor and master students at Kiel University judged students’ written artefacts and provided feedback with the aim to support students in their progression towards the learning goals. The quality of the feedback was coded with respect to its correct judgement of the students’ current levels of achievement and the support it provided regarding next steps in learning. The results show that only a few of the pre-service teachers could correctly judge students’ current levels of achievement and provide feedback that is expected to be effective. Overall, the findings indicate a need for more research in this field and a need for the implementation of formative assessment practices as a topic in pre-service teacher education.  相似文献   

15.
Over the years the debate on the aims, approaches, and impacts of formative assessment has never stopped to grow. Parallel to this growth is the awareness that it is crucial to understand what conceptions teachers have of assessment in order to guarantee more effective teacher education. This paper tries to connect these two fields of research: formative assessment and teacher education through an analysis of teachers’ conceptions: What do teachers think about assessment? What aims do they pursue through it? Do teachers really distinguish between formative and summative assessment? On the backdrop of the formative assessment literature, the article reports on an exploratory research study. Limitations and issues are analysed in order to shed light on teacher education implication and on future educational research paths in the educational assessment field.  相似文献   

16.
As current procedures for teacher assessment are often based on non-standardized, qualitative information derived from multiple sources, the overall validity of the assessment depends heavily on the judgement processes of the assessors. Because it is of great importance for assessors to be aware of their own judgement processes and of the possible threats to validity in these processes, investigating assessors’ perceptions is of vital significance. In the present study, the perceptions of 22 assessors who judged a student teacher pair-wise using a specific assessment procedure were explored using semi-structured interviews. A qualitative analysis of the individual assessors’ perceptions with regard to the essential judgement processes of consideration of evidence and combination of evidence to attain an overall judgement resulted in an overview of successful strategies and threats underlying a valid assessment process. General implications for ensuring the validity of the assessment process and the preparation of assessors are discussed.  相似文献   

17.
Across the globe, standards-based assessment systems are increasingly promoted as a means of improving student outcomes and fulfilling accountability requirements. Within such systems, social moderation is presented as a mechanism for improving the dependability and utility of assessment information. Research emphasises that social moderation processes provide professional learning opportunities; yet this learning tends to be perceived as a by-product rather than a goal of moderation. Situated within the context of New Zealand’s recently implemented National Standards, this article reviews the literature and presents an alternative configuration of the role of social moderation. It foregrounds the professional learning that will be required if these moderation processes are to improve the dependability of National Standards assessment information and contends that reconfiguring teacher professional learning as a goal rather than a by-product of moderation should not only improve dependability and strengthen teacher assessment capability but also assist with lifting student outcomes.  相似文献   

18.
This contribution shows an example of how an assessment innovation can serve as a flywheel for changing teaching and learning. This article first explains the development of an authentic, competence-based performance assessment in pre-vocational secondary education (pre-VET). Using these assessments in pre-VET, that is preparatory to VET, is important for motivating students for a future in VET. Second, in an action research 34 teacher teams of 11 pre-VET institutions implement the new assessment, supported by researchers and teacher coaches, to illuminate how it motivates students, prepares them for VET, and influences teaching and learning. Data from 76 teachers, 68 students, 24 teacher coaches and 3 researchers showed how implementing these assessments raised questions about changing educational content and pedagogy to fit a competence-based approach. Increasing teachers’ expectations of students, changing student-teacher interaction patterns, and developing teachers’ practical understanding of competencies and how they can be observed and discussed in assessments are some of the intriguing challenges that require further support for proper implementation of competence-based assessments and developing an aligned competence-based teaching and learning process.  相似文献   

19.
This paper is about a design-based research project which evaluated the novel use of Lesson Study for assessment (LSfA) purposes. It starts by explaining the principles and design of LSfA procedures based on a Lesson Study model and dynamic assessment principles. It outlines the training and support provided to six Lesson Study teams in three primary and three secondary schools, each involving two class teachers and the school’s SEN coordinator. The evaluation findings focused on the LSfA processes and procedures, for example, the outcomes of LSfA for teacher confidence and knowledge, assessment capabilities and continued benefits. The LSfA process was seen to involve processes such as honest and constructive observations, analysing lessons to see what to change and using knowledge about learning difficulties. Some of the context factors that supported and inhibited the process are also outlined. Analysis of the pre-post LSfA pupil assessments showed a decrease in identifying areas of pupil difficulties and an increased identification of enabling factors. This is interpreted as evidence for the LSfA having dynamic assessment potential. The paper concludes with an account of how the LSfA procedures were adapted in response to this evaluation and suggestions for future development and research.  相似文献   

20.
Traditional moderation of student assessments is often carried out with groups of teachers working face-to-face in a specified location making judgements concerning the quality of representations of achievement. This traditional model has relied little on modern information communications technologies and has been logistically challenging. We argue that social online moderation, coupled with the use of analytical and pairwise scoring methods and technologies, can provide better moderation outcomes and highly valuable professional learning experiences improving teachers’ understandings of assessment standards. This paper reports on a component of a study involving Visual Arts teachers from rural schools making comparative judgements of digitised student artworks. We report the teachers’ observations of the social online moderation processes, including the quality and standard of the digitised artworks, the effectiveness of the pairwise comparison process, the functionality of the online tools, and the concept of using online scoring for moderation and standard setting purposes.  相似文献   

设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号