The quest for fairness in language testing     

Hossein Karami 《Educational Research and Evaluation》2013,19(2-3):158-169

The search for fairness in language testing is distinct from other areas of educational measurement as the object of measurement, that is, language, is part of the identity of the test takers. So, a host of issues enter the scene when one starts to reflect on how to assess people's language abilities. As the quest for fairness in language testing is still in its infancy, even the need for such a research has been controversial, with some (e.g., Davies, 2010) arguing that such research is entirely in vain. This paper will provide an overview of some of the issues involved. Special attention will be given to critical language testing (CLT) as it has had a large impact on language testing research. It will be argued that although CLT has been very effective in revealing the ideological and value implications of the constructs of focus in language testing, extremism in this direction is not justified.  相似文献   

Benchmarking the performance of Bhutanese students with the performance of the students from the OECD's PISA countries     

Gembo Tshering  Vaughan Prain 《Educational Research and Evaluation》2013,19(4):263-281

Setting international benchmarks for education systems of the Organisation for Economic Co-operation and Development (OECD) countries is one of the goals of the OECD's Programme for International Student Assessment (PISA). However, some countries are not able to participate in PISA, despite their desire to set international benchmarks for their education systems. This article presents a method of setting international benchmarks for a country's school education system, without necessarily participating in PISA, by designing a test using the test items released by PISA for public consumption. The method has been implemented in a study that involved 1,500 Grade 10 students across 60 schools in Bhutan. The students were administered a mathematics test constructed from the PISA Mathematical Literacy test items. The study showed that the performance of Bhutanese students was comparable with the performance of the students from the countries that participated in PISA 2003 and that Bhutan could learn from both high- and low-performing school education systems of those countries.  相似文献   

The reliability and validity of the pupil behaviour questionnaire: a child classroom behaviour assessment tool     

Matt Allwood  Kate Allen  Anna Price  Rachel Hayes  Vanessa Edwards  Susan Ball 《Emotional and Behavioural Difficulties》2013,18(4):361-371

ABSTRACT

This paper assesses the reliability and validity of the teacher-completed Pupil Behaviour Questionnaire (PBQ), by comparing it to the already extensively validated teacher-completed Strengths and Difficulties Questionnaire (SDQ). Participants included 2074 primary school children participating in a universal school-based trial and 41 vulnerable children who were taking part in a study exploring the impact of exclusion from school. Exploratory factor analysis results (first factor accounts for 80.8% of the variation in the items) and the high Cronbach’s alpha value of 0.85 indicate that the PBQ consists of one substantive factor/dimension. Strong correlations between the total PBQ score and the conduct sub-scale (Spearman’s correlation coefficient (r_s) = 0.67) and total difficulties score (r_s = 0.59) of the SDQ indicate convergent validity. This study suggests that the PBQ is a reliable measure, and provides some evidence of validity. Further work is needed to test the PBQ in an older, more diverse populations and to measure sensitivity to change.  相似文献   

高等医学院校医学专业英语阅读测试内容效度实证分析     

赵小妹  郜进  蒋玉波 《安徽技术师范学院学报》2013,(6):108-112

本文从内容效度的主要影响因素入手,基于近5年来某高等医学院校医学专业英语阅读测试试题为样本,以语篇输入视角,进行历时性研究与分析,客观评价某高等医学院校医学专业英语阅读测试的内容效度,提出相应建议,以期对提高医学专业英语测试水平有所裨益。  相似文献   

Validity and reliability of a low-cost dynamometer to assess maximal isometric strength of upper limb     

Natalia Romero-Franco  Juan C Fernández-Domínguez  Juan A Montaño-Munuera  Javier Romero-Franco  Pedro Jiménez-Reyes 《Journal of sports sciences》2019,37(15):1787-1793

Muscle imbalance and deficit are key parameters for guiding rehabilitation and sports sessions and avoiding injuries. However, the high cost and non-portable nature of most instruments employed for muscle strength assessment frequently hamper an affordable evaluation in field conditions. This study evaluated the validity and reliability of a low-cost digital dynamometer to assess the maximal isometric strength of upper limb muscles. Fourteen physically active volunteers performed the main movements of the upper limb at maximal isometric strength: flexion-extension, internal-external rotation and abduction-adduction of the shoulder; and flexion-extension of both elbow and wrist. Validity was examined by comparing the strength values from the low-cost digital dynamometer and those measured by an isokinetic dynamometer, assumed as the gold standard. The correlation between both devices was perfect (r > 0.913), while Bland-Altman plots showed absolute agreement between both devices, the maximum range of the values of bias was ?0.99–1.00 N in wrist extension. Inter-tester and intra-tester reliability were excellent for all movements (ICC ≥ 0.855). The low-cost digital dynamometer showed strong validity and excellent reliability in assessing maximal isometric strength during the main movements of the upper limb. Professionals may use it for an affordable isometric muscle strength assessment in field situations.  相似文献   

Important Considerations for Assessment to Function in the Service of Education     

James W. Pellegrino 《Educational Measurement》2020,39(3):81-85

Professor Gordon argues for a significant reorientation in the focus and impact of assessment in education. For the types of assessment activities that he advocates to prosper and positively impact education, serious attention must be paid to two important topics: (1) the conceptual underpinnings of the assessment practices we develop and use to support learning and instruction, and (2) the arguments and evidence we establish for their validity given the intended interpretive use. Such a focus highlights fundamental concepts that have long existed in the broader assessment literature – carefully defining and operationalizing our constructs and then validating the assessments of those constructs. What differs now are the conceptual frameworks, briefly outlined here, that can and must be used to guide both aspects of such work.  相似文献   

The relationship between inertial measurement unit-derived ‘force signatures’ and ground reaction forces during cricket pace bowling     

Samuel J. Callaghan  Robert G. Lockie  Warren A. Andrews  Robert F. Chipchase  Sophia Nimphius 《Sports biomechanics / International Society of Biomechanics in Sports》2020,19(3):307-321

Abstract

This study assessed the reliability and validity of segment measured accelerations in comparison to front foot contact (FFC) ground reaction force (GRF) during the delivery stride for cricket pace bowlers. Eleven recreational bowlers completed a 30-delivery bowling spell. Trunk- and tibia-mounted inertial measurement units (IMUs) were used to measure accelerations, converted to force, for comparisons to force plate GRF discrete measures. These measures included peak force, impulse and the continuous force–time curve in the vertical and braking (horizontal) planes. Reliability and validity was determined by intra-class correlation coefficients (ICC), coefficient of variation (CV), Bland–Altman plots, paired sample t-tests, Pearson’s correlation and one-dimensional (1D) statistical parametrical mapping (SPM). All ICC (0.90–0.98) and CV (4.23–7.41%) were acceptable, except for tibia-mounted IMU braking peak force (CV = 12.44%) and impulse (CV = 18.17%) and trunk vertical impulse (CV = 17.93%). Bland–Altman plots revealed wide limits of agreement between discrete IMU force signatures and force plate GRF. The 1D SPM outlined numerous significant (p < 0.01) differences between trunk- and tibia-located IMU-derived measures and force plate GRF traces in vertical and braking (horizontal) planes. The trunk- and tibia-mounted IMUs appeared to not represent the GRF experienced during pace bowling FFC when compared to a gold-standard force plate.  相似文献   

网络舆情衍进指数构建与实证分析   总被引：1，自引：0，他引：1  

黄微  朱镇远  许烨婧  孙悦 《图书情报工作》2019,63(20):26-33

[目的/意义]提出和构建网络舆情衍进指数，以描述网络舆情演化过程中常衍生出新的子话题的现象，对于舆情预警、预测具有重要的理论及实践意义。[方法/过程]以文本聚类结果和文本聚类有效性为依据，提出网络舆情衍进的判别标准和舆情衍进指数的构建过程，并以"教科书老赖"这一事件作为样本数据进行实证分析。[结果/结论]所构建的舆情衍进速率指数可以用于描述舆情衍进。在突发期阶段话题舆情衍进指数最高，此后逐渐下降，这一阶段的舆情衍进最为剧烈，子话题的出现呈现爆发性增长；舆情衍进指数在舆情蔓延期内出现阶梯式下降，此后保持为负值，舆情的子话题开始逐渐减少，舆情内容本身由发散转为收敛；进入消散期后，子话题数量趋于稳定。作为舆情衍进速率的测度和舆情衍进的判别方式，舆情衍进指数为舆情监管和舆情预警提供了全新的角度。  相似文献   

A longitudinal quantitative investigation into the concurrent validity of self and peer assessment applied to English-Chinese bi-directional interpretation in an undergraduate interpreting course     

《Studies in Educational Evaluation》2018

One of the productive lines of research on self-assessment (SA) and peer assessment (PA) concerns their concurrent validity with respect to a criterion measure. However, similar research has rarely been conducted for spoken-language interpreting. This article therefore reports on a longitudinal study that investigated the validity of self and peer ratings on three performance dimensions of English-Chinese consecutive interpretation (i.e., information completeness, fluency of delivery, and target language quality), taking teachers’ ratings as a yardstick. Major findings include: although the students as a group were unable to replicate teachers’ ratings, they were able to rank-order their performances in a fairly accurate manner and improved their SA and PA accuracy over time. Interpreting directionality seems to moderate the correlational strength of self/teacher ratings and peer/teacher ratings. These results are discussed in relation to previous literature, and pedagogical suggestions are provided to improve SA and PA for bi-directional interpretation.  相似文献   

Static and dynamic accuracy of a magnetic-inertial measurement unit used to provide racket swing kinematics     

Benjamin Kane Williams  Ross H. Sanders  Joong Hyun Ryu  Pitre C. Bourdon  Philip Graham-Smith  Peter J. Sinclair 《Sports biomechanics / International Society of Biomechanics in Sports》2019,18(2):202-214

Magnetic-inertial measurement units (MIMUs) are becoming more prevalent in sports biomechanics and may be a viable tool to evaluate kinematic parameters. This study examined the accuracy of a MIMU to estimate orientation angles under static conditions and dynamically from a squash racket during a forehand drive shot. A MIMU was mounted onto a goniometer and moved through 0–90°, with static data collected at 10° increments during 10 repetitions of all three axes. Typical error analyses showed the MIMU to be very reliable (TE ≤ 0.03°). MIMU accuracy was determined via intraclass correlation coefficients (ICC) (r > 0.999, p < 0.001). An ordinary least products regression showed no proportional bias and minimal fixed bias for all axes. Dynamic accuracy was assessed by comparing MIMU and optical motion capture data of squash racket swing kinematics. A MIMU was fixed onto a racket and 10 participants each hit 10 forehand shots. Mean orientation angle error at ball impact was <0.50° and ICC showed very high correlations (r ≥ 0.988, p < 0.001) for all orientations. Swing phase root mean squared errors were ≤2.20°. These results indicate that a MIMU could be used to accurately and reliably estimate selected racket swing kinematics.  相似文献