The Choice of Response Probability in Bookmark Standard Setting: An Experimental Study     

Peter Baldwin  Melissa J. Margolis  Brian E. Clauser  Janet Mee  Marcia Winward 《Educational Measurement》2020,39(1):37-44

Evidence of the internal consistency of standard-setting judgments is a critical part of the validity argument for tests used to make classification decisions. The bookmark standard-setting procedure is a popular approach to establishing performance standards, but there is relatively little research that reflects on the internal consistency of the resulting judgments. This article presents the results of an experiment in which content experts were randomly assigned to one of two response probability conditions: .67 and .80. If the standard-setting judgments collected with the bookmark procedure are internally consistent, both conditions should produce highly similar cut scores. The results showed substantially different cut scores for the two conditions; this calls into question whether content experts can produce the type of internally consistent judgments that are required using the bookmark procedure.  相似文献   

Culturally Sustaining Pedagogy Extended: Ethnic Pedagogies     

Barbara Laster  Rebecca Shargel  Marcia Watson-Vandiver 《Multicultural Perspectives》2020,22(2):91-100

  相似文献   

Automated Scoring of Constructed‐Response Science Items: Prospects and Obstacles     

Ou Lydia Liu  Chris Brew  John Blackmore  Libby Gerard  Jacquie Madhok  Marcia C. Linn 《Educational Measurement》2014,33(2):19-28

Content‐based automated scoring has been applied in a variety of science domains. However, many prior applications involved simplified scoring rubrics without considering rubrics representing multiple levels of understanding. This study tested a concept‐based scoring tool for content‐based scoring, c‐rater?, for four science items with rubrics aiming to differentiate among multiple levels of understanding. The items showed moderate to good agreement with human scores. The findings suggest that automated scoring has the potential to score constructed‐response items with complex scoring rubrics, but in its current design cannot replace human raters. This article discusses sources of disagreement and factors that could potentially improve the accuracy of concept‐based automated scoring.  相似文献   

Taking stock of sustainability in higher education: a review of the policy literature     

Adam Cheeseman  Jaylene Murray  Marcia McKenzie 《Environmental Education Research》2019,25(12):1697-1712

Abstract

This paper provides a review of the current literature that examines the uptake of sustainability policies in higher education. Articles were retrieved from both ERIC and Scopus databases and then manually reviewed to ensure that they focused on each of: higher education; sustainability; and policy. A total of 91 articles were analysed using a multi-stage process that involved sorting data according to typologies (i.e. temporal, terminology, methodology, geography), coding the text of the articles based on topical content, and an indexing method used to label data for further analysis and the development of broader code categories. Results suggest that drivers and barriers associated with the integration of sustainability policy in higher education are well known; yet increased research is needed to understand best practices and processes by which sustainability can be furthered through higher education policy. In addition, findings demonstrate the need for future research to focus on various aspects of the policy process, including policy development and enactment, and on implications of policy for practice. While there have been some reviews of sustainability policy in higher education research to date, this review contributes to this literature by highlighting research primarily focused on sustainability policy within higher education.  相似文献   

Designing and Validating Assessments of Complex Thinking in Science     

Kihyun Ryoo  Marcia C. Linn 《理论付诸实践》2015,54(3):238-254

Typical assessment systems often measure isolated ideas rather than the coherent understanding valued in current science classrooms. Such assessments may motivate students to memorize, rather than to use new ideas to solve complex problems. To meet the requirements of the Next Generation Science Standards, instruction needs to emphasize sustained investigations, and assessments need to create a detailed picture of students’ conceptual understanding and reasoning processes.

This article describes the design process and potential for automated scoring of 2 forms of inquiry assessment: Energy Stories and MySystem. To design these assessments, we formed a partnership of teachers, discipline experts, researchers, technologists, and psychometricians to align curriculum, assessments, and rubrics. We illustrate how these items document middle school students’ reasoning about energy flow in life science. We used evidence from review by science teachers and experts in the discipline; classroom experiments; and psychometric analysis to validate the assessments, rubrics, and automated scoring.  相似文献   

Donald T. Tosti,Ph.D. and Stephanie F. Jackson,M.A. The Organizational Scan,Performance Levers,and Alignment     

Marcia Kolvitz 《Performance Improvement》2016,55(5):37-43

  相似文献   

Education policy mobility: reimagining sustainability in neoliberal times     

Marcia McKenzie  Andrew Bieler  Rebecca McNeil 《Environmental Education Research》2015,21(3):319-337

This paper is concerned with the twinning of sustainability with priorities of economic neoliberalization in education, and in particular via the mobility or diffusion of education policy. We discuss the literature on policy mobility as well as overview concerns regarding neoliberalism and education. The paper brings these analyses to bear in considering the uptake of sustainability in education policy. We ask to what extent sustainability as a vehicular idea may be twinning with processes of neoliberalization in education policy in ways that may undermine aspirations of, and action on, environmental sustainability. Toward the end of the paper, we draw on data from an empirical study to help elucidate how the analytic frames of policy mobility can inform our analyses of the potential concerns and possibilities of sustainability as a vehicular idea. In particular, we investigate how sustainability and related language have been adopted in the policies of Canadian post-secondary education institutions over time. The paper closes by suggesting the potential implications of the proceeding analyses for policymakers, practitioners, and researchers concerned with sustainability in education policy.  相似文献   

Rural and suburban cluster grouping: Reflections on staff development as a component of program success     

Marcia Gentry  Bill Keilty 《Roeper Review》2013,35(3):147-155

Staff development practices that successfully implemented long‐term applications of cluster grouping in two districts are analyzed, compared, and reviewed. Parallel practices and differences are discussed concerning program beginning, implementation, and maintenance. Conclusions are drawn and six steps for use and consideration by others engaged in gifted program development and implementation are suggested. These steps are: (1) conversations, (2) research, (3) choosing a course of action, (4) implementation, (5) supporting the new program initiative, and (6) maintenance and growth.  相似文献   

Scientific arguments as learning artifacts: designing for learning from the web with KIE     

Philip Bell  Marcia C. Linn 《International Journal of Science Education》2013,35(8):797-817

We designed Knowledge Integration Environment (KIE) debate projects to take advantage of internet resources and promote student understanding of science. Design decisions were guided by the Scaffolded Knowledge Integration instructional framework. We report on design studies that test and elaborate on our instructional framework. Our learning studies assess the arguments students construct using the Knowledge Integration Environment debate project about light propagation and, explore the relationship between students' views of the nature of science and argument construction. We examine how students use evidence, determine when they add further ideas and claims and measure progress in understanding light propagation. To a modeate degree, students' views of the nature of science align with the quality of the arguments.  相似文献   

Validation of automated scoring of science assessments     

Ou Lydia Liu  Joseph A. Rios  Michael Heilman  Libby Gerard  Marcia C. Linn 《科学教学研究杂志》2016,53(2):215-233

  相似文献