共查询到20条相似文献，搜索用时 62 毫秒
1.
Leonidas Kyriakides Bert P.M. Creemers Anastasia Panayiotou Gudrun Vanlaar Michael Pfeifer Gašper Cankar 《欧洲师范教育杂志》2014,37(2):125-143
This paper argues for the value of using student ratings to measure quality of teaching. An international study to test the validity of the dynamic model of educational effectiveness was conducted. At classroom level, the model consists of eight factors relating to teacher behaviour: orientation, structuring, questioning, teaching modelling, application, management of time, teacher role in making classroom a learning environment and assessment. In each participating country (i.e. Belgium/Flanders, Cyprus, Germany, Greece, Ireland and Slovenia), a sample of at least 50 primary schools was used and all grade 4 students (n?=?9967) were asked to complete a questionnaire concerning the eight factors of the dynamic model. Structural equation modelling techniques were used to test the construct validity of the questionnaire. Both across- and within-country analyses revealed that student ratings are reliable and valid for measuring the functioning of the teacher factors of the dynamic model. Implications for teacher education are drawn. 相似文献
2.
Anastasia Panayiotou Leonidas Kyriakides Bert P. M. Creemers Léan McMahon Gudrun Vanlaar Michael Pfeifer Galini Rekalidou Matevž Bren 《Educational Assessment, Evaluation and Accountability》2014,26(1):73-93
This study investigates the extent to which the factors included in the dynamic model of educational effectiveness are associated with student achievement gains in six different European countries. At classroom level, the dynamic model refers to eight factors relating to teacher behavior in the classroom: orientation, structuring, questioning, teaching-modeling, application, management of time, teacher role in making classroom a learning environment, and classroom assessment. This paper presents results concerned with the impact of the teacher factors on student achievement. In each participating country (i.e., Belgium/Flanders, Cyprus, Germany, Greece, Ireland, and Slovenia), a sample of at least 50 primary schools (n?=?334) was drawn. Written tests in mathematics and science were administered to all grade 4 students (n?=?10,742) at the beginning and at the end of the school year 2010–2011. Students were also asked to complete a questionnaire concerning the eight teacher factors of the dynamic model. Structural equation modeling techniques were used to test the construct validity of the student questionnaire. Both across and within country analyses revealed that student ratings are reliable and valid for measuring the functioning of the teacher factors included in the dynamic model. Multilevel analyses revealed that teacher factors are associated with student achievement gains in mathematics and science. Implications for the development of educational effectiveness research and for improving quality of teaching are drawn. 相似文献
3.
4.
Christine Suurtamm Martha Koch Ann Arden 《Assessment in Education: Principles, Policy & Practice》2010,17(4):399-417
This article responds to calls that have been made for research into how teachers incorporate new assessment ideas into their practice. We draw on a large‐scale study that examined the implementation of reform in mathematics in grades 7–10 in Ontario, Canada. We present teacher questionnaire data, and focus on data gathered from case studies for details of what new assessment practices look like in classrooms. We show teachers using a variety of forms of assessment and using assessment to improve student learning. Observed assessment practices went beyond tests to include the use of journals, observation, questioning, self‐assessment and unique forms of ‘quizzes’. These practices allowed teachers to examine students’ mathematical thinking and provided feedback to students and teachers to improve student learning. We also observed the important role of collaboration, coherence, and the teachers’ beliefs in supporting new assessment practices. 相似文献
5.
Marieke Van der Schaaf Liesbeth Baartman Frans Prins 《Assessment & Evaluation in Higher Education》2012,37(7):847-860
Student portfolios are increasingly used for assessing student competences in higher education, but results about the construct validity of portfolio assessment are mixed. A prerequisite for construct validity is that the portfolio assessment is based on relevant portfolio content. Assessment criteria, are often used to enhance this condition. This study aims to identify whether assessment criteria can improve content, argumentation and communication during teacher moderation while judging student portfolios. Six teachers scored 32 student portfolios in dyads with and without assessment criteria. Their judgement processes were qualitatively analysed. Results indicated that the quality of their judgement processes was low, since teachers based their judgements mainly on their own personal opinion and less on evidence found in the portfolio. Teachers barely paid attention to quality checks and easily agreed with each other. When teachers used assessment criteria, the quality of their judgements slightly improved. They based their judgements more on relevant evidence, used less personal experiences and more often checked the quality of their judgement processes. It is concluded that the quality of teacher portfolio judgement is low, and that the use of assessment criteria can enhance its quality. 相似文献
6.
Bronwen Cowie Beverley Cooper 《Assessment in Education: Principles, Policy & Practice》2017,24(2):147-163
AbstractA number of trends are converging to drive the need for more informed teacher data use. These include advocacy for formative assessment and the need for teachers to account for student learning. In this context, assessment literacy and data literacy have emerged as a focus in research and professional development. Problematically, research signals that developing assessment/data literacy is challenging with evidence that teachers may not have mastered relevant aspects of mathematics and statistics. This paper reports lecturer, student teacher and school leader views of the role and requirements of data literacy using data from a larger study into how to foster student teacher mathematical thinking for the breadth of teacher professional work. Data were generated via interviews, surveys and document analysis. Findings suggest a concern and opportunity to develop assessment/data literacy as this calls on mathematical and statistical understanding. 相似文献
7.
Suzanne McMahon 《Assessment in Education: Principles, Policy & Practice》2015,22(3):368-389
We report one teacher’s response to a top-down shift from external examinations to internal teacher assessment for summative purposes in the Republic of Ireland. The teacher adopted a comparative judgement approach to the assessment of secondary students’ understanding of a chemistry experiment. The aims of the research were to investigate whether comparative judgement can produce assessment outcomes that are valid and reliable without producing undue workload for the teachers involved. Comparative judgement outcomes correlated as expected both with test marks and with existing student achievement data, supporting the validity of the approach. Further analysis suggested that teacher judgement privileged scientific understanding, whereas marking privileged factual recall. The estimated reliability of the outcome was acceptably high, but comparative judgement was notably more time-consuming than marking. We consider how validity and efficiency might be improved and the contributions that comparative judgement might offer to summative assessment, moderation of teacher assessment and peer assessment. 相似文献
8.
The theoretical construct of teacher noticing has allowed mathematics teacher educators to examine teacher thinking and practice by looking at the range of activities that teachers notice in the classroom. Guided by this approach to the study of teacher thinking, the central goal of this exploratory study was to identify what prospective science teachers notice when evaluating evidence of student understanding in another teacher's inquiry‐based unit. Our results are based on the qualitative analysis of 43 prospective teachers' evaluations of assessment evidence presented to them in the form of a video case and associated written artifacts. Analysis of our data revealed two major categories of elements, Task‐General and Task‐Specific, noticed by our study participants. Task‐General elements included attention to learning objectives, independent student work, and presentation issues and they often served to guide or qualify the specific inquiry skills that were evaluated. Task‐Specific elements included the noticing of students' abilities to perform different components of an investigation. In general, study participants paid attention to important general and specific aspects of student work in the context of inquiry. However, they showed preferential attention to those process skills associated with designing an investigation versus those practices related to the analysis of data and generation of conclusions. Additionally, their interpretations of assessment outcomes were largely focused on the demonstration of general science process skills; much less attention was paid to the analysis of the epistemological validity or scientific plausibility of students' ideas. Our results provide insights into the design of meaningful learning experiences for prospective teachers that elicit, challenge, and enrich their conceptions of student understanding in the context of inquiry. © 2013 Wiley Periodicals, Inc. J Res Sci Teach 50:189–208, 2013 相似文献
9.
This research study was conducted to address pre-service physics teachers’ assessment literacy and its implementation into practice. The research was both quantitative and qualitative in nature. For the quantitative aspect of the study, the researchers determined the participants’ assessment literacy after their enrolment with the assessment course. Intentions of the qualitative part were to validate the results drawn from the quantitative research and to examine the participants’ assessment literacy in the practical realm. Data were collected by using a valid and reliable instrument developed by the first author, a questionnaire and the participants’ project assignment including implementation of assessment. According to the quantitative results, the pre-service physics teachers’ assessment literacy was quite high. Findings obtained from the qualitative analyses were compatible with the quantitative results. However, the study revealed gaps between assessment literacy in theory and practice. This study suggests that teacher education programmes should highlight theories of assessment as well as types of evaluation, stress validity and reliability of assessment enabling students to engage in both traditional and performance-based assessment methods, and provide opportunities for students to reflect, practice, and revise these methods. 相似文献
10.
The purpose of this study was to develop a scale with which to examine students’ self-regulation (SR) in three types of online interaction. Using scale development steps, we constructed the online self-regulation questionnaire (OSRQ), a self-report survey. A total of 799 online students participated in the study. Data from 400 randomly selected participants were used for exploratory factor analysis (EFA), and data of the remaining 399 participants were used for confirmatory factor analysis (CFA). The EFA yielded three factors as hypothesized: SR in interaction between student and content, SR in interaction between student and student and SR in interaction between student and teacher. The CFA demonstrated that the factor structures appearing in the EFA were also observed with different participants. In addition, we found convergent validity in the OSRQ. The study contributes to understanding SR in online learning settings. 相似文献
11.
Gita Taasoobshirazi MarLynn Bailey John Farley 《International Journal of Science Education》2013,35(17):2769-2786
The Physics Metacognition Inventory was developed to measure physics students’ metacognition for problem solving. In one of our earlier studies, an exploratory factor analysis provided evidence of preliminary construct validity, revealing six components of students’ metacognition when solving physics problems including knowledge of cognition, planning, monitoring, evaluation, debugging, and information management. The college students’ scores on the inventory were found to be reliable and related to students’ physics motivation and physics grade. However, the results of the exploratory factor analysis indicated that the questionnaire could be revised to improve its construct validity. The goal of this study was to revise the questionnaire and establish its construct validity through a confirmatory factor analysis. In addition, a Rasch analysis was applied to the data to better understand the psychometric properties of the inventory and to further evaluate the construct validity. Results indicated that the final, revised inventory is a valid, reliable, and efficient tool for assessing student metacognition for physics problem solving. 相似文献
12.
Econometric studies suggest that student achievement may be improved if high-performing teachers are substituted for low-performing teachers. Drawing upon a recent study linking teacher performance on licensure exams with gains in student achievement, an analysis was conducted to determine the cost-effectiveness of requiring teacher applicants to meet a minimum 1000 SAT test score requirement, while raising teacher salaries by 45 percent in order to maintain an adequate pool of candidates. Results indicate that the cost-effectiveness of this approach to raising teacher quality is substantially lower than the cost-effectiveness of a competing approach for raising student achievement, involving the implementation of systems that provide formative assessment feedback to students and teachers regarding student performance in math and reading. The implementation of formative assessment instead of less cost-effective approaches would help to achieve the important goal of raising math and reading achievement while using fewer resources. The savings in resources may then be used to achieve other important educational goals—those that are not well-addressed through formative assessment. 相似文献
13.
14.
This study aimed to design and validate the Teacher Identity Measurement Scale (TIMS) for assessing primary student teachers’ professional identity. Based on identity theory and a systematic review into quantitative instruments of teacher identity, teacher identity was decomposed in four first-order constructs: motivation, self-image, self-efficacy, and task perception. This resulted in a measurement scale consisting of 46 items. The factorial design was examined by administering the TIMS to first- and second-year primary student teachers. In phase 1, involving 17 students, qualitative scale development methods were used to assess the construct validity. In phase 2, its second-order factor structure was tested and confirmed among a sample of 211 students. In phase 3, this structure was cross-validated among a new sample of 419 students. The instrument may contribute to understanding primary student teacher’s professional development and can be used as a tool to support the process of developing a professional teacher identity. 相似文献
15.
This qualitative study aimed to explore teacher curriculum approaches and the strategies attached to each approach because they influence the taught curriculum, teacher development and student learning. The study was therefore grounded in teacher curriculum development, curriculum implementation, teacher development, student cognitive and affective change and constructivism. To address this study's qualitative and exploratory purposes, it made use of the qualitative paradigm at the levels of ontology (multiple curriculum realities), epistemology (interaction with rather than detachment from respondents) and methodology (using idiographic methodology and instruments). In line with the qualitative paradigm, it used qualitative case-study (method), general interviews, pre/post-lesson interviews, group interviews and participant observation (data collection methods) in addition to grounded theory (data analysis approach) to meet the research purposes. Working with English as a foreign language (EFL) teachers and mixed-nationality college students, the study reached a teacher curriculum approach classification comprising curriculum-transmission, curriculum-development and curriculum-making. It recommended alternatives for teacher, student and curriculum development, curriculum implementation and teacher training. 相似文献
16.
In this research, the authors raised the issue that prior studies had failed to address the nested structure of data in examining the construct validity of an instrument measuring students' behavioral and emotional participation in academic activities in the classroom. To address this question, the authors illustrated the utility of the multilevel confirmatory factor analysis (MCFA) approach to reexamine the construct validity of this instrument. The sample consisted of 2,041 students in 5th grade from 67 classes in Hong Kong. First, the results justified the requirement of MCFA and indicated that the 4-factor model tested with MCFA provided better fit to the data than that tested with a single-level confirmatory factor analysis (CFA). Second, the study also provided adequate support for a multilevel second-order two-factor model that distinguished engagement from disaffection. Third, the factor structure was invariant across the student level and the classroom level for both the 4-factor model and the second-order two-factor model. Fourth, the results highlighted the presence of ambiguity in differentiating between the dimensions at the classroom level and supported the unidimensionality of the classroom-level construct. Fifth, student engagement was significantly and positively correlated with mathematics test scores, teachers' classroom-management practices, teacher support, and student order in the classroom. Finally, the authors discuss the implications of the study and its limitations and offer suggestions for model selection and explorations for future research. 相似文献
17.
Wilfried Admiraal Mark HoeksmaMarie-Thérèse van de Kamp Gee van Duin 《Teaching and Teacher Education》2011,27(6):1019-1028
The richness and complexity of video portfolios endanger both the reliability and validity of the assessment of teacher competencies. In a post-graduate teacher education program, the assessment of video portfolios was evaluated for its reliability, construct validity, and consequential validity. Although video portfolio facilitated a reliable and valid assessment of teacher competencies, procedures to improve assessment quality were also revealed and are therefore discussed: more explicit grounding of assessment results in the data, peer debriefing, prolonged engagement with the assessment data, cross-checking to find confirmatory or counter examples. 相似文献
18.
In this case study, we examine the consequential validity of using edTPA in a social justice-oriented, urban teacher preparation program. According to the developers of edTPA, a primary purpose is to support teacher candidate learning, yet our analysis suggests that edTPA does not support learning when used during student teaching. Our 16 participants, who are primarily teacher candidates of color and many first-generation college students, and who all passed edTPA, unanimously indicated that edTPA increased their mental and financial stress, which they linked to design elements including high stakes, standardization, and external scoring. Participants also critiqued the construct of teaching represented in edTPA, arguing that dispositions and a social justice orientation are missing and that edTPA is more about following procedures than supporting candidate learning. Moreover, edTPA encouraged inequitable practices, including focusing on high-achieving classes and selecting curricula based on scoring procedures instead of student need. Overall, our analysis indicates that there is not strong consequential validity evidence to support the use of edTPA as an assessment during student teaching, particularly in social justice-oriented programs, yet suggests edTPA could be a useful tool if stakes and proceduralism are reduced and scoring is conducted locally. 相似文献
19.
To advance the discussion on the validity of student evaluations of university teaching, student ratings of two teaching dimensions – student involvement and rapport – were compared with corresponding observer ratings. Seven potential bias variables were tested with regard to their impact on the students’ teaching assessment: three teacher characteristics (first impression, enthusiasm, humour) and four student characteristics (prior interest, expected grades, study experience, class attendance). Bias was defined as an impediment of the students’ assessment of teaching on course level. By means of bivariate correlations with course averages and two-level latent moderated structural equations, data of 1,716 students in 80 courses were analysed. Results showed that all three teacher characteristics were genuinely connected to rapport, and even explained variance of the student-rated variable when controlling for observer-rated rapport. The assessment of student involvement was not modified by the teacher characteristics except for teacher enthusiasm, which affected the student evaluation when controlling for observed involvement and, moreover, moderated the relation between the observed and the student-rated variable. For the examined student characteristics, no biasing effects were found – neither on rapport nor on student involvement. 相似文献
20.
Yuankun Yao Matt Thomas Nicole Nickens Joyce Anderson Downing Ruth S. Burkett Sharon Lamson 《Educational Measurement》2008,27(1):10-24
This study applied Messick's unified, multifaceted concept of construct validity to an electronic portfolio system used in a teacher education program. The subjects included 128 preservice teachers who recently completed their final portfolio reviews and student teaching experiences. Four of Messick's six facets of validity were investigated for the portfolio in this study, along with a discussion of the remaining facets examined in two previous studies. The evidence provided support for the substantive and generalizability aspects of validity, and limited support for the content, structural, external, and consequential aspects of validity. It was suggested that the electronic portfolio may be used as one requirement for certification purposes, but may not be valid for the purpose of assessing teacher competencies . 相似文献