首页 | 本学科首页   官方微博 | 高级检索  
相似文献
 共查询到20条相似文献，搜索用时 46 毫秒
1.
Student evaluations of teaching (SETs) are widely used to measure teaching quality in higher education and compare it across different courses, teachers, departments and institutions. Indeed, SETs are of increasing importance for teacher promotion decisions, student course selection, as well as for auditing practices demonstrating institutional performance. However, survey response is typically low, rendering these uses unwarranted if students who respond to the evaluation are not randomly selected along observed and unobserved dimensions. This paper is the first to fully quantify this problem by analyzing the direction and size of selection bias resulting from both observed and unobserved characteristics for over 3000 courses taught in a large European university. We find that course evaluations are upward biased, and that correcting for selection bias has non-negligible effects on the average evaluation score and on the evaluation-based ranking of courses. Moreover, this bias mostly derives from selection on unobserved characteristics, implying that correcting evaluation scores for observed factors such as student grades does not solve the problem. However, we find that adjusting for selection only has small impacts on the measured effects of observables on SETs, validating a large related literature which considers the observable determinants of evaluation scores without correcting for selection bias.  相似文献   

2.
Abstract

Peer assessment was introduced into the assessment strategy of two marketing modules on two undergraduate programmes at Manchester Metropolitan University. A questionnaire was used to elicit responses from a sample of 80 students concerning their attitudes to and experience of, the peer assessment exercise. Students felt that the benefits of peer assessment were: the increase in personal motivation as a result of their active involvement in the assessment process; the opportunity to compare and discuss the assignment, and the opportunity to gain knowledge and develop a greater understanding of the assignment content and assessment process. Criticisms included the effects of personal bias on the marks awarded, the interpretation of criteria and the ability of the students to assess. Some students regarded peer assessment as an incentive to perform, while others saw it as an unfair system that lacked objectivity. Over half the sample regarded assessment as solely a role for the tutor. The research found that peer assessment made a valuable contribution to the variety of assessment and it enabled students to better understand the assessment process, however, it was a time consuming process for tutors  相似文献   

3.
Course evaluations (often termed student evaluations of teaching or SETs) are pervasive in higher education. As SETs increasingly shift from pencil-and-paper to online, concerns grow over the lower response rates that typically accompany online SETs. This study of online SET response rates examined data from 678 faculty respondents and student response rates from an entire semester. The analysis focused on those tactics that faculty employ to raise response rates for their courses, and explored instructor and course characteristics as contributing factors. A comprehensive regression model was evaluated to determine the most effective tactics and characteristics. Using incentives had the most impact on response rates. Other effective tactics that increase response rates include reminding students to take the evaluation, explaining how the evaluations would be used to improve instruction, sending personal emails and posting reminders on Blackboard®. Incentives are not widely used; however, findings suggest that non-point incentives work as well as point-based ones, as do simple-to-administer minimum class-wide response rate expectations (compared to individual completion).  相似文献   

4.
Research Findings: To test children’s use of testimony of others, 3 – 9 years (N = 227) made judgments about a potential peer transgression in which the intentions of the protagonist were ambiguous, after hearing two different forms of testimony. The 2 forms of testimony were (a) opposing opinion-based testimony from an adult authority versus a peer consensus group and (b) knowledge-based testimony (eyewitness testimony) that was counter to the participants’ initial judgments. Findings revealed that when testimony was presented in an opinion-based format, children were likely to side with the opinion that reflected their own interpretation of the peer encounter, regardless of whether the opinion came from a peer consensus or an adult authority. However, when knowledge-based testimony was introduced in support of the opposite of children’s initial interpretation of the ambiguous peer encounter, children most often changed their initial judgment to align with the new testimony. That is, children used knowledge-based testimony but not opinion-based testimony to evaluate a potential transgression. Practice or Policy: These findings demonstrate that the way in which testimony is delivered to children has a direct influence on their decision making about peer interactions and has relevance for teacher–student discourse in the classroom.  相似文献   

5.
ABSTRACT

In 2010, new amendments regarding special education were made to the Finnish Basic Education Act (642/2010), and they were officially adopted in 2011. The three-tiered support system that was introduced can be considered the Finnish approach to moving education toward a more inclusive system since it emphasises all teachers’ responsibility to deliver support within the regular educational setting, representing a new feature in the policy documents. This has brought about new expectations for special education teachers’ (SETs’) roles. Our research aims to contribute to knowledge about the implementation of the three-tiered support system and SETs’ roles in Swedish-speaking schools in Finland. The data were collected using a questionnaire (N = 158). The results indicate that the SETs have an important role in the three-tiered support system, both as those with the knowledge and those who share this knowledge. The SETs’ role is more evident when it comes to pupils receiving support on the second and third tiers. Although inclusive values are emphasised in the policy documents, the SETs still use most of their time teaching pupils in educational settings that are often relatively segregated (individual or small-group teaching), and for example, co-teaching seems to be a less frequent approach to collaboration.  相似文献   

6.
There is a plethora of research on student evaluations of teaching (SETs) regarding their validity, susceptibility to bias, practical use and effective implementation. Given that there is not one study summarising all these domains of research, a comprehensive overview of SETs was conducted by combining all prior meta-analyses related to SETs. Eleven meta-analyses were identified, and nine meta-analyses covering 193 studies were included in the analysis, which yielded a small-to-medium overall weighted mean effect size (r = .26) between SETs and the variables studied. Findings suggest that SETs appear to be valid, have practical use that is largely free from gender bias and are most effective when implemented with consultation strategies. Research, teaching and policy implications are discussed.  相似文献   

7.

This paper outlines the characteristics of peer mediation in schools and its potential, evident in the literature, for reducing pupil–pupil conflicts referred to teachers. Then, drawing on personal experience, research and a review of literature, the author argues that for peer mediation projects to be effective they need to be in synergy with the culture of the school, including its approach and vision to the management of conflict. Making this argument requires a means of modelling school culture, which will be outlined. Finally, the author argues that attention also needs to be given to how the service will be sustained.  相似文献   

8.
The literature on student evaluations of teaching (SETs) generally presents two opposing camps: those who believe in the validity and usefulness of SETs, and those who do not. Some researchers have suggested that ‘SET deniers’ resist SETs because of their own poor SET results. To test this hypothesis, I analysed essays by 230 SET researchers (170 lead authors) and classified the researchers as having negative, neutral or positive attitudes towards SETs. I retrieved their RateMyProfessors.com (RMP) scores and, using logistic regression, found that lead authors with negative attitudes towards SETs were 14 times more likely to score below an estimated RMP average than lead authors with positive attitudes towards SETs. Co-authors and researchers with neutral attitudes, on the other hand, did not significantly differ from the RMP average. These results suggest that personal attitudes towards SETs may drive research findings.  相似文献   

9.
Abstract

Students’ dissatisfaction with peer assessment has been widely documented. While most relevant literature places focus on the cognitive (content and uptake of feedback) or structural (feedback design) dimensions, students’ emotions in peer assessment have received scant attention. This study investigates the social-affective impacts of peer assessment by analysing students’ appeal letters addressed to their tutors, reflective posts in the online discussion forum and responses to a survey. A thematic analysis of data indicated three main aspects of students’ (dis)satisfaction: content, scores and process of peer assessment. The most negative emotion that students expressed was related to ‘disrespectful’ behaviour and attitudes of peer reviewers, whereas the feeling of appreciation was triggered by the helpful feedback attributes which were perceived as reflecting reviewers’ respect to others’ works. Students generally held mixed feelings toward peer assessment, valuing learning in the process of providing and receiving feedback but showing resistance to using peer assessment for summative purposes. The findings highlight the significance of respect in peer assessment and argue that the perceived lack of mutual respect seems to underpin the nature of students’ dissatisfaction. This study carries implications for nurturing students’ respectful attitudes and behaviour in and through peer assessment.  相似文献   

10.

Although part-time (p/t) faculties constitute a growing proportion of college instructors, there is little work on their level of teaching effectiveness relative to full-time (f/t) faculty. Previous work on a key indicator of perceived teaching effectiveness, student evaluation of teaching (SET), and faculty status (p/t/ vs f/t) is marked by a series of shortcomings including lack of a systematic theoretical framework and lack of multivariate statistical analysis techniques to check for possible spuriousness. The present study corrects for these shortcomings. Data consist of SETs from 175 sections of criminal justice classes taught at a Midwestern urban university. Controls are introduced for variables drawn from the literature and include ascribed characteristics of the professor, grade distribution, and structural features of the course (e.g., level, size). The results of a multivariate regression analysis indicate that even after controlling for the other predictors of SETs, p/t faculty receive significantly higher student evaluation scores than f/t faculty. Further, faculty status was the most important predictor of SETs. The results present the first systematic evidence on faculty status and SETs.  相似文献   

11.

This article reports data from the process evaluation of a randomised controlled trial of peer-led sex education in English secondary schools. Data from 52 focus group discussions in 19 schools and selected items from a questionnaire survey completed by 7770 students in 1998/99 are used to compare student views on teacher- and peer-led sex education. Questionnaire data show that a significantly greater proportion of students taught by peer educators than teachers felt that sex education was enjoyable, engaging and useful to them. Data also show that a slightly greater proportion of students taught by teachers felt the classroom was well controlled. Data from an analysis of the focus group discussions are used to explore and illustrate factors which students associated with the acceptability and satisfaction of the peer-led intervention. The importance of peer educator empathy and similarity with students is highlighted and data show how these characteristics are associated with peer educators' choice of teaching methods, the content of lessons and the sexual values and attitudes they espouse. The influence of contextual factors like student prior expectations and experiences of relationships with teachers, school environment and norms are considered along with the potential influence of the research process on responses.  相似文献   

12.
As student evaluation of teaching (SET) instruments are increasingly administered online, research has found that the response rates have dropped significantly. Validity concerns have necessitated research that explores student motivation for completing SETs. This study uses Vroom's [(1964). Work and motivation (3rd ed.). New York, NY: John Wiley & Sons] expectancy theory to frame student focus group responses regarding their motivations for completing and not completing paper and online SETs. Results show that students consider the following outcomes when deciding whether to complete SETs: (a) course improvement, (b) appropriate instructor tenure and promotion, (c) accurate instructor ratings are available to students, (d) spending reasonable amount of time on SETs, (e) retaining anonymity, (f) avoiding social scrutiny, (g) earning points and releasing grades, and (h) being a good university citizen. Results show that the lower online response rate is largely due to students’ differing feelings of obligation in the 2 formats. Students also noted that in certain situations, students often answer SETs insincerely.  相似文献   

13.
In the last 10–15 years, many institutions of higher education have switched from paper-and-pencil methods to online methods of administering student evaluations of teaching (SETs). One consequence has been a significant reduction in the response rates to such instruments. The current study was conducted to identify whether offering in-class time to students to complete online SETs would increase response rates. A quasi-experiment (nonequivalent group design) was conducted in which one group of tenured faculty instructed students to bring electronic devices with internet capabilities on a specified day and offered in-class time to students to complete online SETs. A communication protocol for faculty members’ use was developed and implemented. A comparison group of tenured faculty who did not offer in-class time for SET completion was identified and the difference-in-differences method was used to compare the previous year’s response rates for the same instructor teaching the same course across the two groups. Response rates were substantially higher when faculty provided in-class time to students to complete SETs. These results indicate that high response rates can be obtained for online SETs submitted by students in face-to-face classes if faculty communicate the importance of SETs in both their words and actions.  相似文献   

14.
Microteaching has gained considerable attention for its effectiveness in rapid and contextual training in professional development programs. However, the interpretive quality of the teaching demonstration and peer feedback may influence individuals’ attribution and self-correction, leading to ineffective learning. In this study, a microteaching workshop in a professional development program for 78 elementary school science teachers was investigated. The results showed that the effectiveness of microteaching was negatively affected by participants’ perception bias due to social categorization. Moreover, it was indicated that the participants’ perception of the in-group and out-group, classified by the degree of the individuals’ science knowledge, fostered social categorization. Participants tended to experience perception conflicts caused by their inability to see personal faults, and a typical perception bias of “seeing one’s own strengths and seeing others’ shortcomings” was more frequently recognized in the out-group. These results converge to highlight the importance of social categorization in perception bias relevant to microteaching.  相似文献   

15.
Institutions of higher education continue to migrate student evaluations of teaching (SET) from traditional, in-class paper forms to online SETs. Online SETs would favorably compare to paper-and-pencil evaluations were it not for widely reported response rate decreases that cause SET validity concerns stemming from possible nonresponse bias. To combat low response rates, one institution introduced a SET application for mobile devices and piloted formal synchronous classroom time for SET completion. This paper uses the Leverage Salience Theory to estimate the impact of these SET process changes on overall response rates, open-ended question response rates, and open end response word counts. Synchronous class time best improves SET responses when faculty encourage completion on keyboarded devices and provide students SET completion time in the first 15 min of a class meeting. Full support from administrators requires sufficient wireless signal strength, IT infrastructure, and assuring student access to devices for responses clustering around meeting times.  相似文献   

16.
Abstract

Student evaluations of teaching and courses (SETs) are part of the fabric of tertiary education and quantitative ratings derived from SETs are highly valued by tertiary institutions. However, many staff do not engage meaningfully with SETs, especially if the process of analysing student feedback is cumbersome or time-consuming. To address this issue, we describe a proof-of-concept study to automate aspects of analysing student free text responses to questions. Using Quantext text analysis software, we summarise and categorise student free text responses to two questions posed as part of a larger research project which explored student perceptions of SETs. We compare human analysis of student responses with automated methods and identify some key reasons why students do not complete SETs. We conclude that the text analytic tools in Quantext have an important role in assisting teaching staff with the rigorous analysis and interpretation of SETs and that keeping teachers and students at the centre of the evaluation process is key.  相似文献   

17.
新公共管理运动的发展引发了高等教育质量社会问责制的兴起。高校重视学生评教是对社会重视高等教育的组织绩效、学生主体地位以及教育教学效能的一种适应性回应。学生评教制度设计面临着学生评价能力的有限性、有效教学标准的多样性、干扰因素作用的复杂性以及对学术自由影响的不确定性等因素的制约。我国高校内部评估体系建设中应将学生评教与专家评教相结合,制定多样化的有效教学标准以及适度降低学生评教结果使用的比重。  相似文献   

18.
Traditionally the measures used to evaluate the impact of an educational programme on student outcomes and the extent to which students change is a comparison of the student's pre‐test scores with his/her post‐test scores. However, this method of evaluating change may be problematic due to the confounding factor of response shift bias when student self‐reports of change are used. Response shift bias occurs when the student's internal frame of reference of the construct being measured, for example research ability or critical thinking, changes between the pre‐test and the post‐test due to the influence of the educational programme. To control for response shift bias the retrospective pre‐test method was used to evaluate the outcomes achieved from students completing a research module at master's level. The retrospective pre‐test method differs from the traditional pre‐test–post‐test design in that both post‐test and pre‐test perceptions of respondents are collected at the same time. The findings indicated that response shift bias was evident in that the programme had significantly greater impact on outcomes than identified using the traditional pre‐test–post‐test design leading to the conclusion that students may overestimate their ability at the commencement of an educational programme. The retrospective pre‐test design is not a replacement for the traditional pre‐test–post‐test measures but may be a useful adjunct in the evaluation of the impact of educational programmes on student outcomes.  相似文献   

19.
The current study explores the feelings and thoughts that faculty have about their student evaluations of teaching (SET). To assess the perceptions of SETs, all teaching faculty in one college at a western Land Grant University were asked to complete an anonymous online survey. The survey included demographic questions (i.e. gender; rank such as assistant, associate, and full professor; and positions like non-tenure track, tenure track, and tenured) as well as questions related to faculty's feelings while reading their SETs. While minimal differences were found in responses based on rank or position, several differences were found based on faculty gender. Overall, female faculty appear to be more negatively impacted by student evaluations than male faculty. These gender differences support previous research that suggests males and females receive and react differently to personal evaluation. Resultant suggestions include modifying surveys from anonymous to confidential and offering professional development training for faculty.  相似文献   

20.
When response rates on student evaluations of teaching (SETs) are low, inability to properly interpret and use responses from the students who do participate is a big problem. Where does the motivation to participate break down, and where and how does it make sense to invest efforts in rectifying that? In this study, we examined 641 university students’ reported behaviours and motivation related to their SET participation. In terms of behaviour, students who seldom or never participate in online SET tools reported a willingness to invest, at most, five minutes in the process, though the majority never even open the online evaluation links when they receive them. In terms of motivation, they significantly differed from students who always participate with distinctly lower levels of: (1) willingness to participate at all, (2) perception of autonomy and competence, (3) meaningfulness, (4) personal value, (5) engagement in others’ participation, and (6) understanding of the value of their own participation for others’ benefit. Based on these findings, we propose a strategy for increasing future response rates, particularly among recalcitrant students, in order to be able to gather sufficient and reliable results for the work of improving teaching.  相似文献   

设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号