The effect of adaptivity on the reliability coefficient in adaptive comparative judgement     

Tom Bramley  Sylvia Vitello 《Assessment in Education: Principles, Policy & Practice》2019,26(1):43-58

Comparative Judgement (CJ) is an increasingly widely investigated method in assessment for creating a scale, for example of the quality of essays. One area that has attracted attention in CJ studies is the optimisation of the selection of pairs of objects for judgement. One approach is known as adaptive comparative judgement (ACJ). It has been claimed in the literature that ACJ produces very high reliability, often higher than can be obtained by conventional marking. Bramley showed by simulation that adaptivity can substantially inflate the apparent reliability in ACJ. The empirical study described here compared an adaptive with a non-adaptive CJ study using GCSE English essays. An all-play-all set of comparisons of a subset of the essays allowed the extent of scale inflation to be quantified: the reported adaptive reliability was 0.97 whereas the deflated value was 0.84. The value from the non-adaptive study was 0.72. However, the scale from the non-adaptive study correlated slightly higher with external variables, suggesting the non-adaptive study was no less valid than the adaptive one.  相似文献   

对大学外语考试的思考     

宋力英 《黑龙江教育学院学报》2006,25(4):152-153

在高校外语教学中,四、六级外语统考已经成为大学生必须参加的一种考试。因为有了四级证,学生就业机会就会增大。但外语测试中存在着相当多的问题,如试题题型单一,猜测性较大,导致应试教学的产生,不能调动学生学习的自主性和积极性,也不能有效地考查出学生的实际水平,因此,我国的大学外语测试亟待改革。  相似文献   

柴油机的可维修性研究   总被引：1，自引：0，他引：1  

张丽萍 《南通职业大学学报》2002,16(2):33-35

建立了柴油机具有共性的可维修系统的失效率模型,论述了柴油机的可维修性理论,探讨了其最佳维修周期的界定问题,给出了计算实例。该方法对其他系统的可维修性问题也具有普遍意义。  相似文献   

在历史与虚构之间——《押沙龙,押沙龙》的叙事策略解读     

俞全华 《唐山师范学院学报》2007,29(1):24-27

在《押沙龙,押沙龙》中,福克纳打破了文学与历史的界限,采用了小说创作的虚构策略。在叙述层次的设置、叙述者的选择、叙述声音的迥异以及叙述的真实与否方面,充分表达了他对美国南方历史中黑人种族问题的深切关注。然而他所传递的“历史”却丧失了传统意义上的客观真实性,而凸现为新历史主义批评家所谓的“新历史”或“文本化”的历史。  相似文献   

主观题评分教师评分效应研究     

周群 《考试研究》2007,(3)

评分教师的评分效应和评分量表研究是研究主观题评分误差的核心问题。本论文以2006年高考政治(上海卷)第38题(论述题)为例,运用ACER Conquest的Raters Effect模型研究,结果显示该大题基本没有表现出模糊性、趋中性和等级限制等评分误差,评分教师能够比较好地区分考生不同行为特征,除个别评分教师的评分一致性还有待提高外,评分松紧度差异比较显著。为此,作者提出根据松紧度调整考试分数的方法。  相似文献   

基于神经网络的数控机床可靠性预计研究     

余香梅  舒彤 《九江师专学报》2007,26(6):40-43

本文提出了利用人工神经网络来辅助实现数控机床的可靠性预计的方法，建立了用于数控机床可靠性预测的三层BP神经网络模型，给出了具体的算法，并通过实例证明该方法比传统的数学模型预计方法更准确和可靠。  相似文献   

教育装备的可靠性分析与可靠性管理     

赵锦红  胡又农 《中国教育技术装备》2005,(5):2-5

教育装备可靠性是指教育装备在规定的条件下和规定的时间内完成规定功能的能力.在教育装备全系统、全寿命管理中,教育装备的可靠性是一个不可或缺的重要指标.文章针对教育装备的全寿命周期各阶段的具体情况,详细讨论了教育装备可靠性管理的一些问题.  相似文献   

CET考试听力试题分析与对策     

李亮  田庆轩  梁丹一 《河北北方学院学报(社会科学版)》2007,23(5):71-73

听力理解能力是外语学习者应首先具备的语言能力,大学英语教育尤为如此。改革后的新四级考试已经全面推广。通过对最新CET考试听力试题的分析,肯定了CET听力试卷的专业性和权威性,同时浅析了听力部分的应对方案。  相似文献   

虚拟企业可靠性及其理论评价模型研究   总被引：2，自引：0，他引：2  

包国宪  顾波军 《科学学与科学技术管理》2006,27(5):109-113

综合虚拟企业及可靠性理论,在深入分析影响虚拟企业功能因素的基础上提出虚拟企业可靠性理论评价模型,为对虚拟企业及虚拟企业可靠性进行更加深入的研究打下了理论基础.  相似文献   

The Teacher Behavior Inventory: validation of teacher behavior in an interactive lecture environment     

Siti Nurma Hanim Hadie  Asma’ Hassan  Saiful Bahri Talip  Muhamad Saiful Bahri Yusoff 《Teacher Development》2019,23(1):36-49

Students’ rating of teacher behaviors provides valuable information on teaching improvement and instructional quality. Unfortunately, there is a lack of new validated instruments for measuring teacher behaviors. The Teacher Behaviors Inventory is an old inventory that was initially developed to measure teaching behaviors as regards lecture-based instructions, which is effected through the use of low-inference items. The aim of this study was to assess its continued suitability in the present educational setting by examining its construct validity and internal consistency through the lens of one lecturer’s teaching behaviors, as rated by 527 students after six interactive lectures. The variables evaluated, as mentioned above, were achieved after an items removal process, which resulted in a 32-item version. Apart from being valid and reliable, this condensed version allows for immediate assessment of teaching behaviors after an instruction session as the rating procedure is now more straightforward and less time-consuming, and also enables a reduction in rating errors. Therefore, the 32-item format serves as a practical diagnostic feedback tool in the present educational arena, permitting a longitudinal teaching behavior assessment to enhance teachers’ professional development.  相似文献