共查询到20条相似文献，搜索用时 62 毫秒
1.
2.
During the development of large‐scale curricular achievement tests, recruited panels of independent subject‐matter experts use systematic judgmental methods—often collectively labeled “alignment” methods—to rate the correspondence between a given test's items and the objective statements in a particular curricular standards document. High disagreement among the expert panelists may indicate problems with training, feedback, or other steps of the alignment procedure. Existing procedural recommendations for alignment reviews have been derived largely from single‐panel research studies; support for their use during operational large‐scale test development may be limited. Synthesizing data from more than 1,000 alignment reviews of state achievement tests, this study identifies features of test–standards alignment review procedures that impact agreement about test item content. The researchers then use their meta‐regression results to propose some practical suggestions for alignment review implementation. 相似文献
3.
Recent Government policy in England and Wales on Information and Communication Technology (ICT) in schools is heavily influenced by a series of non‐randomised controlled studies. The evidence from these evaluations is equivocal with respect to the effect of ICT on literacy. In order to ascertain whether there is any effect of ICT on one small area of literacy, spelling, a systematic review of all randomised controlled trials (RCTs) was undertaken. Relevant electronic databases (including BEI, ERIC, Web of Science, PsycINFO, The Cochrane Library) were searched. Seven relevant RCTs were identified and included in the review. When six of the seven studies were pooled in a meta‐analysis there was an effect, not statistically significant, in favour of computer interventions (Effect size = 0.37, 95% confidence interval =–0.02 to 0.77, p = 0.06). Sensitivity and sub‐group analyses of the results did not materially alter findings. This review suggests that the teaching of spelling by using computer software may be as effective as conventional teaching of spelling, although the possibility of computer‐taught spelling being inferior or superior cannot be confidently excluded due to the relatively small sample sizes of the identified studies. Ideally, large pragmatic randomised controlled trials need to be undertaken. 相似文献
4.
This paper reports a systematic review of the quasi‐experimental literature in the field of adult literacy and numeracy, published between 1980 and 2002. We included 27 controlled trials (CTs) that evaluated strategies and pedagogies designed to increase adult literacy and numeracy: 18 CTs with no effect sizes (incomplete data) and 9 CTs with full data. These nine trials are examined in detail for this paper. Of these nine trials, six evaluated interventions in literacy and three evaluated interventions in literacy and numeracy. Three of the nine trials showed a positive effect for the interventions, five trials showed no difference and one trial showed a positive effect for the control treatment. The quality of the trials was variable, but many of them had some methodological problems. There was no evidence of publication bias in the review. There have been few attempts to expose common adult literacy or numeracy programmes to rigorous evaluation and therefore in terms of policy and practice it is difficult to make any recommendations as to the type of adult education that should be supported. In contrast, however, the review does provide a strong steer for the direction to be taken by educational researchers: because of the present inadequate evidence base rigorously designed randomised controlled trials and quasi‐experiments are required as a matter of urgency. 相似文献
5.
Kristen Nielsen 《Journal of Research in Reading》2014,37(1):1-16
Student writing achievement is essential to lifelong learner success, but supporting writing can be challenging for teachers. Several large‐scale analyses of publications on writing have called for further study of instructional methods, as the current literature does not sufficiently address the need to support best teaching practices. Self‐assessment methods in writing instruction present meaningful ways to promote student writing achievement through reflection and meta‐cognition during the writing process. Self‐assessment practices are described in publications across the academic disciplines where writing is required, and close investigations of the methods are also published in the research fields of literacy, English education and composition. This study aims to bridge these fields to construct a clear and comprehensive understanding of self‐assessment methods. Self‐assessment encompasses a wide range of practices and varied terminology. It is essential to clarify effective methods of self‐assessment and to disseminate practical information to educators. This paper presents the findings of an analysis of the literature yielding: (1) a theoretical framework for self‐assessment methods in writing instruction; (2) an overview of concepts/practices; (3) a list of literature‐supported strategies for effective classroom use derived from a study of a vast body of literature. Results strongly support self‐assessment as a means to foster student writing achievement, middle school through higher education. Delineated strategies can assist instructors with self‐assessment implementation. 相似文献
6.
The technique of meta‐analysis has been credited with resolving research issues in the areas of class size and the efficacy of psychotherapy, yet meta‐analyses have failed to form a consensus regarding the effects of student ratings feedback to college teachers. This failure can be traced to three types of problems: (a) methodological problems with the technique of meta‐analysis; (b) the quality of the research base; and (c) the social and professional context in which research is conducted. Meta‐analysis is an important addition to what may become a rigorous review methodology, but it is not a substitute for the qualitative review. Comprehensive meta‐analyses should include (a) a discursive review of each study, (b) a report of how each effect‐size was calculated, (c) the location of the statistics on which the calculation was based, and (d) a discussion of the factors that limit the validity of the statistic. Individual authors can contribute to the validity of future quantitative syntheses by reporting their results more thoroughly and clearly. 相似文献
7.
This article addresses how methodological approaches relying on video can be included in literacy research to capture changing literacies. In addition to arguing why literacy is best studied in context, we provide empirical examples of how small, head‐mounted video cameras have been used in two different research projects that share a common aim: understanding the complex ways in which literacy is a part of school practices. The complexity of literacy practices taking place in classrooms, where students draw on a number of texts for a variety of purposes and different literacy discourses co‐exist in the same setting, poses a serious challenge for those who wish to study literacy in educational settings. The methodology presented in this article is our attempt to meet this challenge. Our approach relies on using video equipment in innovative ways to capture multiple perspectives, involving research participants in the data collection process and the early stages of analysis, and analysing video data with digital coding software. These methods are combined to obtain a more systematic and detailed insight into the contexts in which literacy takes place. 相似文献
8.
9.
教师测评素养是教师教育和教师发展的重要组成部分。通过对国外有关教师测评素养研究文献的梳理和分析,其研究内容主要包括教师测评素养的构成、现状及培训需求、测量工具的开发和验证、测评素养发展途径和影响因素等。这些研究对我国开展教师测评素养相关研究有一定的参考价值,同时也启示我们可以在研究对象、研究方法和研究内容上进一步拓展,要基于我国国情,开展教师测评素养及其测量测量工具的本土化研究。 相似文献
10.
Jean Langlois Christian Bellemare Josée Toulouse George A. Wells 《Anatomical sciences education》2017,10(3):235-241
Anatomy knowledge has been found to include both spatial and non‐spatial components. However, no systematic evaluation of studies relating spatial abilities and anatomy knowledge has been undertaken. The objective of this study was to conduct a systematic review of the relationship between spatial abilities test and anatomy knowledge assessment. A literature search was done up to March 20, 2014 in Scopus and in several databases on the OvidSP and EBSCOhost platforms. Of the 556 citations obtained, 38 articles were identified and fully reviewed yielding 21 eligible articles and their quality were formally assessed. Non‐significant relationships were found between spatial abilities test and anatomy knowledge assessment using essays and non‐spatial multiple‐choice questions. Significant relationships were observed between spatial abilities test and anatomy knowledge assessment using practical examination, three‐dimensional synthesis from two‐dimensional views, drawing of views, and cross‐sections. Relationships between spatial abilities test and anatomy knowledge assessment using spatial multiple‐choice questions were unclear. The results of this systematic review provide evidence for spatial and non‐spatial methods of anatomy knowledge assessment. Anat Sci Educ 10: 235–241. © 2016 American Association of Anatomists. 相似文献
11.
The field of higher education research has bourgeoned in the past decades, addressing a wide range of topics. Being in a rapidly expanding and interdisciplinary field of research, higher education scholars have demonstrated exigency for aggregating research findings to map the research landscape, identify future research directions, and bridge the research-practice divide. In this connection, systematic literature reviews have been carried out to consolidate research findings. With a proliferation of systematic literature reviews in higher education, the aim of this meta, methodological review is to provide a state-of-the-art systematic literature review methodologies in the field of higher education. Adhering to the exploratory nature of this study, this review analyses systematic literature reviews published in 16 top-tiered international journals in higher education (n = 160). Through qualitative research synthesis using thematic analysis and informed by grounded theory, a methodological framework comprising six stages and 20 steps is developed, which might help to instigate methodological dialogue between researchers when it comes to conducting systematic literature reviews. A handy checklist for conducting and evaluating systematic literature reviews in higher education is created. 相似文献
12.
This study examined how specific guidelines and heuristics have been used to identify methodological rigor associated with single‐case research designs based on quality indicators developed by Horner et al. Specifically, this article describes how literature reviews have applied Horner et al.'s quality indicators and evidence‐based criteria. Ten literature reviews were examined to ascertain how literature review teams (a) used the criteria recommended by Horner et al. as meeting the 5‐3‐20 evidence‐based practice (EBP) thresholds (five studies conducted across three different research teams that include a minimum of 20 participants) to assess single‐case methodological rigor; and (b) applied the 5‐3‐20 thresholds to determine whether the independent variables reviewed qualified as potential effective practices. The 10 literature reviews included 120 single‐case designs. This study found that 33% of the reviewed single‐case designs met Horner et al.'s quality indicator criteria. Three of the literature reviews concluded that examined practices met criteria to qualify as an EBP. Recommendations related to quality indicator criteria and EBP established by the literature review teams as well as directions for future research are discussed. 相似文献
13.
AbstractAssessment feedback from teachers gains consistently low satisfaction scores in national surveys of student satisfaction, with concern surrounding its timeliness, quality and effectiveness. Equally, there has been heightened interest in the responsibility of learners in engaging with feedback and how student assessment literacy might be increased. We present results from a five-year longitudinal mixed methods enquiry, thematically analysing semi-structured interviews and focus groups with undergraduate students who have experienced dialogic feed-forward on a course in a British university. We use inferential statistics to compare performance pre and post-assessment intervention. The assessment consisted of submitting a draft coursework essay, which was discussed and evaluated face-to-face with the course teacher before a self-reflective piece was written about the assessment process and a final essay was submitted for summative grading. We evidence that this process asserted a positive influence on the student learning experience in a number of inter-related cognitive and affective ways, impacting positively upon learning behaviour, supporting student achievement and raising student satisfaction with feedback. We advocate a cyclic and iterative approach to dialogic feed-forward, which facilitates learners’ longitudinal development. Programme teams should offer systematic opportunities across curricula for students to understand the rationale for and develop feedback literacy. 相似文献
14.
Kirsty Younger Louise Gascoine Victoria Menzies Carole Torgerson 《Journal of Further & Higher Education》2019,43(6):742-773
Widening participation (WP) in higher education (HE) is an increasingly important policy issue, with interventions to increase participation from minority ethnic, low-income and other under-represented groups undertaken in HE sectors in many countries. In the UK there is a large amount of WP activity but a lack of robust evidence of its effectiveness. This article presents a systematic review in the topic area of WP in HE. We included studies of systematic review, randomised controlled trial (RCT) and quasi-experimental (QE) designs, and assessed evidence of the effectiveness of university access strategies and approaches in relation to the participation of disadvantaged students at university. We searched for, quality appraised and synthesised the international evidence, that is, evidence published in any country, in the English language. The findings from 4 systematic reviews and 12 experimental studies (4 RCTs, 4 RDDs and 4 QEDs) are presented as narrative syntheses in a series of thematic sub-topics. We found some evidence of effectiveness for a number of university access interventions. ‘Black box’ WP programmes (those with multiple elements in a single programme) and financial incentives were found to be effective. However, much of the evidence had design limitations and the majority were conducted in the US. The article concludes with research recommendations in relation to UK interventions, including suggested designs for future quasi-experimental evaluation. 相似文献
15.
Assessment and decision-making in child maltreatment cases is difficult. Practitioners face many uncertainties and obstacles during their assessment and decision-making process. Research exhibits shortcomings in this decision-making process. The purpose of this literature review is to identify and discuss methods to overcome these shortcomings. We conducted a systematic review of the published literature on decision-making using PsychINFO and MEDLINE from 2000 through May 2014. We included reviews and quantitative research studies that investigated methods aimed at improving professional decision-making on child abuse and neglect in child welfare and child protection. Although many researchers have published articles on decision-making including ideas and theories to improve professional decision-making, empirical research on these improvements is scarce. Available studies have shown promising results. Structured decision-making has created a greater child-centred and holistic approach that takes the child's family and environment into account, which has made practitioners work more systematically and improved the analysis of complex situations. However, this approach has not improved inter-rater agreement on decisions made. Shared decision-making may improve the participation of parents and children and the quality of decisions by taking client treatment preferences into account in addition to scientific evidence and clinical experience. A number of interesting developments appear in recent research literature; however, child welfare and child protection must find additional inspiration from other areas, e.g., mental health services, because research on decision-making processes in child welfare and child protection is still rare. 相似文献
16.
《British journal of educational technology : journal of the Council for Educational Technology》2018,49(3):370-384
Three‐dimensional virtual world (3DVW) have been adopted extensively in the education sector worldwide, and there has been remarkable growth in the application of these environments for distance learning. A wide variety of universities and educational organizations across the world have utilized this technology for their regular learning and teaching programs. The current study conducts a systematic review of the published studies relevant to the application of 3DVWs in higher education. A search of the literature was carried out in eight high‐ranking scientific digital libraries. Following scrutiny according to inclusion and exclusion criteria, 165 papers out of 1402 publications were selected for review from a variety of disciplines over a 10‐year time period. The systematic review process were summarised, a number of paper reviews were conducted and results in conjunction with applicability of 3DVWs in higher education were extracted. In this study, various application areas of 3DVWs in higher education were found and classified into 13 main categories. Additionally, implications for research and practice are presented to provide new directions for further research and practice in the field. 相似文献
17.
Edys S. Quellmalz Michael J. Timms Matt D. Silberglitt Barbara C. Buckley 《科学教学研究杂志》2012,49(3):363-393
This article reports on the collaboration of six states to study how simulation‐based science assessments can become transformative components of multi‐level, balanced state science assessment systems. The project studied the psychometric quality, feasibility, and utility of simulation‐based science assessments designed to serve formative purposes during a unit and to provide summative evidence of end‐of‐unit proficiencies. The frameworks of evidence‐centered assessment design and model‐based learning shaped the specifications for the assessments. The simulations provided the three most common forms of accommodations in state testing programs: audio recording of text, screen magnification, and support for extended time. The SimScientists program at WestEd developed simulation‐based, curriculum‐embedded, and unit benchmark assessments for two middle school topics, Ecosystems and Force & Motion. These were field‐tested in three states. Data included student characteristics, responses to the assessments, cognitive labs, classroom observations, and teacher surveys and interviews. UCLA CRESST conducted an evaluation of the implementation. Feasibility and utility were examined in classroom observations, teacher surveys and interviews, and by the six‐state Design Panel. Technical quality data included AAAS reviews of the items' alignment with standards and quality of the science, cognitive labs, and assessment data. Student data were analyzed using multidimensional Item Response Theory (IRT) methods. IRT analyses demonstrated the high psychometric quality (reliability and validity) of the assessments and their discrimination between content knowledge and inquiry practices. Students performed better on the interactive, simulation‐based assessments than on the static, conventional items in the posttest. Importantly, gaps between performance of the general population and English language learners and students with disabilities were considerably smaller on the simulation‐based assessments than on the posttests. The Design Panel participated in development of two models for integrating science simulations into a balanced state science assessment system. © 2012 Wiley Periodicals, Inc. J Res Sci Teach 49: 363–393, 2012 相似文献
18.
Effect sizes as result interpretation aids in single‐subject experimental research: description and application of four nonoverlap methods 
下载免费PDF全文
下载免费PDF全文 Salih Rakap 《British Journal of Special Education》2015,42(1):11-33
Single‐subject experimental research (SSER), one of the most commonly used research methods in special education and applied behaviour analysis, is a scientific, rigorous and valid method to evaluate the effectiveness of behavioural, educational and psychological treatments. However, studies using single‐subject experimental research designs are often excluded from meta‐analyses of evidence‐based practices due to the lack of methodological consensus on the type of effect size indices to be used to determine treatment effect. To promote the use of effect size indices as an adjunct to visual analysis, this article describes four nonoverlap methods (PND, IRD, PEM‐T and Tau‐U) and demonstrates their application to data obtained from studies employing different SSER designs. Advantages and disadvantages of each method are highlighted and considerations for selecting the most appropriate method are provided for researchers and practitioners. 相似文献
19.
Maggie MacLure 《教育政策杂志》2013,28(4):393-416
The article presents a critique of the discourse of ‘systematic review’ in education, as developed and promoted by the EPPI‐Centre at the University of London. Based on a close reading of the exhortatory and instructional literature and 30 published reviews, it argues that the approach degrades the status of reading and writing as scholarly activities, tends to result in reviews with limited capacity to inform policy or practice, and constitutes a threat to quality and critique in scholarship and research. The claims that are made for the transparency, accountability and trustworthiness of systematic review do not therefore, it is argued, stand up to scrutiny. The article concludes that systematic review is animated, not just by dissatisfaction with the uncertainties of educational research (a dissatisfaction that it shares with the ‘evidence‐informed movement’ with which it is associated), but by a fear of language itself. 相似文献
20.
John Everatt Ian Smythe Dina Ocampo Eva Gyarmathy 《Journal of Research in Reading》2004,27(2):141-151
This paper focused on the assessment of phonological skills amongst children with developmental dyslexia. Findings from assessments of English and Hungarian monolingual children with and without literacy deficits and bilingual Filipino children with and without literacy deficits in English indicated that performance on phonological‐based tasks often used in dyslexia assessment batteries was influenced by the language background. Monolingual English children with poor literacy skills showed characteristic deficits in most areas of phonological ability, whereas Hungarian counterparts showed little evidence of such difficulties. Bilingual Filipino children with poor English literacy skills showed equivalent profiles to their monolingual counterparts only when assessments in both English and Filipino were considered. The paper discusses difficulties of generalising assessment procedures from one language context to another. 相似文献