Important Considerations for Assessment to Function in the Service of Education     

James W. Pellegrino 《Educational Measurement》2020,39(3):81-85

Professor Gordon argues for a significant reorientation in the focus and impact of assessment in education. For the types of assessment activities that he advocates to prosper and positively impact education, serious attention must be paid to two important topics: (1) the conceptual underpinnings of the assessment practices we develop and use to support learning and instruction, and (2) the arguments and evidence we establish for their validity given the intended interpretive use. Such a focus highlights fundamental concepts that have long existed in the broader assessment literature – carefully defining and operationalizing our constructs and then validating the assessments of those constructs. What differs now are the conceptual frameworks, briefly outlined here, that can and must be used to guide both aspects of such work.  相似文献   

Static and dynamic accuracy of a magnetic-inertial measurement unit used to provide racket swing kinematics     

Benjamin Kane Williams  Ross H. Sanders  Joong Hyun Ryu  Pitre C. Bourdon  Philip Graham-Smith  Peter J. Sinclair 《Sports biomechanics / International Society of Biomechanics in Sports》2019,18(2):202-214

Magnetic-inertial measurement units (MIMUs) are becoming more prevalent in sports biomechanics and may be a viable tool to evaluate kinematic parameters. This study examined the accuracy of a MIMU to estimate orientation angles under static conditions and dynamically from a squash racket during a forehand drive shot. A MIMU was mounted onto a goniometer and moved through 0–90°, with static data collected at 10° increments during 10 repetitions of all three axes. Typical error analyses showed the MIMU to be very reliable (TE ≤ 0.03°). MIMU accuracy was determined via intraclass correlation coefficients (ICC) (r > 0.999, p < 0.001). An ordinary least products regression showed no proportional bias and minimal fixed bias for all axes. Dynamic accuracy was assessed by comparing MIMU and optical motion capture data of squash racket swing kinematics. A MIMU was fixed onto a racket and 10 participants each hit 10 forehand shots. Mean orientation angle error at ball impact was <0.50° and ICC showed very high correlations (r ≥ 0.988, p < 0.001) for all orientations. Swing phase root mean squared errors were ≤2.20°. These results indicate that a MIMU could be used to accurately and reliably estimate selected racket swing kinematics.  相似文献   

Digital Module 09: Sociocognitive Assessment for Diverse Populations https://ncme.elevate.commpartners.com     

Robert J. Mislevy  Maria Elena Oliveri 《Educational Measurement》2019,38(4):110-111

  相似文献   

An effective measure of childhood adversity that is valid with older adults     

《Child abuse & neglect》2018

Childhood adversity (CA) has life-long effects that we are just beginning to understand. The Midlife in the United States (MIDUS) data is a rich resource that could contribute to the knowledge of the impact of CA in the later years but, while a number of CA items are included in MIDUS, a cumulative CA scale based on those items has not been created. Development of a CA scale would create numerous research opportunities within MIDUS and overcome some of the challenges of using a secondary dataset. The present study aimed to demonstrate that a cumulative measure of CA that is valid with older adults could be created using retrospective MIDUS Refresher study data (Ryff et al., 2016); analysis included data collected from 2011 to 2014 from 2542 adults ages 23–76 (1017 adults 55–76). The present study provided a rationale for which measures of CA to include in a cumulative scale. The distribution of eight types of CA and the cumulative CA scale were consistent with findings from past studies of CA. The factor structure of the cumulative CA scale was similar to the original ACE study and included two factors: household dynamics and child abuse/neglect. Consistent with past studies, the CA scale predicted a negative association with life satisfaction and a positive association with number of chronic conditions. This study demonstrated that an effective cumulative measure of CA could be created that would be of value to other studies using MIDUS data to explore outcomes with older adults.  相似文献   

The relationship between inertial measurement unit-derived ‘force signatures’ and ground reaction forces during cricket pace bowling     

Samuel J. Callaghan  Robert G. Lockie  Warren A. Andrews  Robert F. Chipchase  Sophia Nimphius 《Sports biomechanics / International Society of Biomechanics in Sports》2020,19(3):307-321

Abstract

This study assessed the reliability and validity of segment measured accelerations in comparison to front foot contact (FFC) ground reaction force (GRF) during the delivery stride for cricket pace bowlers. Eleven recreational bowlers completed a 30-delivery bowling spell. Trunk- and tibia-mounted inertial measurement units (IMUs) were used to measure accelerations, converted to force, for comparisons to force plate GRF discrete measures. These measures included peak force, impulse and the continuous force–time curve in the vertical and braking (horizontal) planes. Reliability and validity was determined by intra-class correlation coefficients (ICC), coefficient of variation (CV), Bland–Altman plots, paired sample t-tests, Pearson’s correlation and one-dimensional (1D) statistical parametrical mapping (SPM). All ICC (0.90–0.98) and CV (4.23–7.41%) were acceptable, except for tibia-mounted IMU braking peak force (CV = 12.44%) and impulse (CV = 18.17%) and trunk vertical impulse (CV = 17.93%). Bland–Altman plots revealed wide limits of agreement between discrete IMU force signatures and force plate GRF. The 1D SPM outlined numerous significant (p < 0.01) differences between trunk- and tibia-located IMU-derived measures and force plate GRF traces in vertical and braking (horizontal) planes. The trunk- and tibia-mounted IMUs appeared to not represent the GRF experienced during pace bowling FFC when compared to a gold-standard force plate.  相似文献   

Validity and reliability of a low-cost dynamometer to assess maximal isometric strength of upper limb     

Natalia Romero-Franco  Juan C Fernández-Domínguez  Juan A Montaño-Munuera  Javier Romero-Franco  Pedro Jiménez-Reyes 《Journal of sports sciences》2019,37(15):1787-1793

Muscle imbalance and deficit are key parameters for guiding rehabilitation and sports sessions and avoiding injuries. However, the high cost and non-portable nature of most instruments employed for muscle strength assessment frequently hamper an affordable evaluation in field conditions. This study evaluated the validity and reliability of a low-cost digital dynamometer to assess the maximal isometric strength of upper limb muscles. Fourteen physically active volunteers performed the main movements of the upper limb at maximal isometric strength: flexion-extension, internal-external rotation and abduction-adduction of the shoulder; and flexion-extension of both elbow and wrist. Validity was examined by comparing the strength values from the low-cost digital dynamometer and those measured by an isokinetic dynamometer, assumed as the gold standard. The correlation between both devices was perfect (r > 0.913), while Bland-Altman plots showed absolute agreement between both devices, the maximum range of the values of bias was ?0.99–1.00 N in wrist extension. Inter-tester and intra-tester reliability were excellent for all movements (ICC ≥ 0.855). The low-cost digital dynamometer showed strong validity and excellent reliability in assessing maximal isometric strength during the main movements of the upper limb. Professionals may use it for an affordable isometric muscle strength assessment in field situations.  相似文献   

网络舆情衍进指数构建与实证分析   总被引：1，自引：0，他引：1  

黄微  朱镇远  许烨婧  孙悦 《图书情报工作》2019,63(20):26-33

[目的/意义]提出和构建网络舆情衍进指数，以描述网络舆情演化过程中常衍生出新的子话题的现象，对于舆情预警、预测具有重要的理论及实践意义。[方法/过程]以文本聚类结果和文本聚类有效性为依据，提出网络舆情衍进的判别标准和舆情衍进指数的构建过程，并以"教科书老赖"这一事件作为样本数据进行实证分析。[结果/结论]所构建的舆情衍进速率指数可以用于描述舆情衍进。在突发期阶段话题舆情衍进指数最高，此后逐渐下降，这一阶段的舆情衍进最为剧烈，子话题的出现呈现爆发性增长；舆情衍进指数在舆情蔓延期内出现阶梯式下降，此后保持为负值，舆情的子话题开始逐渐减少，舆情内容本身由发散转为收敛；进入消散期后，子话题数量趋于稳定。作为舆情衍进速率的测度和舆情衍进的判别方式，舆情衍进指数为舆情监管和舆情预警提供了全新的角度。  相似文献   

A longitudinal quantitative investigation into the concurrent validity of self and peer assessment applied to English-Chinese bi-directional interpretation in an undergraduate interpreting course     

《Studies in Educational Evaluation》2018

One of the productive lines of research on self-assessment (SA) and peer assessment (PA) concerns their concurrent validity with respect to a criterion measure. However, similar research has rarely been conducted for spoken-language interpreting. This article therefore reports on a longitudinal study that investigated the validity of self and peer ratings on three performance dimensions of English-Chinese consecutive interpretation (i.e., information completeness, fluency of delivery, and target language quality), taking teachers’ ratings as a yardstick. Major findings include: although the students as a group were unable to replicate teachers’ ratings, they were able to rank-order their performances in a fairly accurate manner and improved their SA and PA accuracy over time. Interpreting directionality seems to moderate the correlational strength of self/teacher ratings and peer/teacher ratings. These results are discussed in relation to previous literature, and pedagogical suggestions are provided to improve SA and PA for bi-directional interpretation.  相似文献   

Cross-Cultural Adaptation and Psychometric Properties of the Portuguese Version of the Life Skills Scale for Sport     

José Roberto Andrade do Nascimento-Junior  Leonardo de Sousa Fortes  Gabriel Lucas Morais Freire  Daniel Vicentini de Oliveira  Lenamar Fiorese  Lorcan Donal Cronin 《Measurement in physical education and exercise science》2020,24(1):11-24

ABSTRACT

This research adapted the Life Skills Scale for Sport (LSSS) into Portuguese and provided evidence for its construct validity. Study 1 included four translators and five academics who developed a Portuguese version of the LSSS (P-LSSS). During this study, evidence for the content and substantive aspects of construct validity was provided using an expert panel and 25 sports participants. Study 2 included 413 participants that completed the P-LSSS. Within this study, evidence for the structural aspect of construct validity was provided via factor analyses. Study 3 included 134 participants who completed the P-LSSS and a measure of motivation. This study provided evidence for the external aspect of construct validity, with results showing more self-determined motivation had positive relationships with participant’s life skills development. Overall, our findings provided evidence for the construct validity of P-LSSS scores. Researchers and practitioners can use the P-LSSS to assess life skills development within sports participants.  相似文献   

Validation of the swimming competence questionnaire for children     

Derwin K. C. Chan  Alfred Sing Yeung Lee  Duncan J. Macfarlane  Martin S. Hagger  Kyra Hamilton 《Journal of sports sciences》2020,38(14):1666-1673

ABSTRACT

Two studies were employed to test the reliability and validity of the Swimming Competence Questionnaire (SCQ) among primary school children. Study 1 was a cross-sectional survey in 4959 primary school children. Study 2 was a pre-post-test quasi-experiment among 1609 primary school children who underwent a 20-lesson learn-to-swim programme. In Study 1, exploratory structural equation modelling revealed excellent goodness-of-fit and scale reliability for a two-factor model comprising distance and skill factors, which supported the construct and convergent validity. SCQ scores were significantly and positively correlated with swimming outcomes (i.e., self-efficacy, intention, swimming frequency), which supported SCQ’s concurrent and criterion validity. Average variance extracted for the SCQ factors exceeded cut-off criteria supporting discriminant validity. In Study 2, pre-test SCQ scores correlated significantly and positively with the SCQ scores, self-efficacy, intention, and swimming frequency at post-test, which supported SCQ’s test-retest reliability and predictive validity. Positive intraclass correlation between SCQ scores and coach ratings at post-test provided evidence for SCQ’s inter-rater reliability. SCQ scores significantly improved at post-test, which supported SCQ’s ecological validity. In conclusion, findings indicate that the SCQ is a valid and reliable measure to assess primary school children’s swimming competence, in terms of swimming distance and basic water survival skills.  相似文献