The Choice of Response Probability in Bookmark Standard Setting: An Experimental Study     

Peter Baldwin  Melissa J. Margolis  Brian E. Clauser  Janet Mee  Marcia Winward 《Educational Measurement》2020,39(1):37-44

Evidence of the internal consistency of standard-setting judgments is a critical part of the validity argument for tests used to make classification decisions. The bookmark standard-setting procedure is a popular approach to establishing performance standards, but there is relatively little research that reflects on the internal consistency of the resulting judgments. This article presents the results of an experiment in which content experts were randomly assigned to one of two response probability conditions: .67 and .80. If the standard-setting judgments collected with the bookmark procedure are internally consistent, both conditions should produce highly similar cut scores. The results showed substantially different cut scores for the two conditions; this calls into question whether content experts can produce the type of internally consistent judgments that are required using the bookmark procedure.  相似文献   

A Critical Look into the Beuk Standard-Setting Method     

Adam E. Wyse 《Educational Measurement》2020,39(1):52-60

One commonly used compromise standard-setting method is the Beuk (1984) method. A key assumption of the Beuk method is that the emphasis given to the pass rate and the percent correct ratings should be proportional to the extent that the panelists agree on their ratings. However, whether the slope of Beuk line reflects the emphasis that panelists believe should be assigned to the pass rate and the percentage correct ratings has not be fully tested. In this article, I evaluate this critical assumption of the Beuk method by asking panelists to assign importance weights to their percentage correct and pass rate judgments. I show that in several cases that the emphasis suggested by the Beuk slope is noticeably different from what one would expect and is inconsistent with importance weight ratings. I also suggest two ways that the importance weights can be used to calculate alternate cut scores, and I show that one of the ways of calculating cut scores using the importance weights leads to larger potential differences in cut score estimates. I suggest that practitioners should consider collecting importance weights when the Beuk method is used for determining cut scores.  相似文献   

Information retrieval in the workplace: A comparison of professional search practices     

Tony Russell-Rose  Jon Chamberlain  Leif Azzopardi 《Information processing & management》2018,54(6):1042-1057

Legal researchers, recruitment professionals, healthcare information professionals, and patent analysts all undertake work tasks where search forms a core part of their duties. In these instances, the search task is often complex and time-consuming and requires specialist expertise to identify relevant documents and insights within large domain-specific repositories and collections. Several studies have been made investigating the search practices of professionals such as these, but few have attempted to directly compare their professional practices and so it remains unclear to what extent insights and approaches from one domain can be applied to another. In this paper we describe the results of a survey of a purposive sample of 108 legal researchers, 64 recruitment professionals and 107 healthcare information professionals. Their responses are compared with results from a previous survey of 81 patent analysts. The survey investigated their search practices and preferences, the types of functionality they value, and their requirements for future information retrieval systems. The results reveal that these professions share many fundamental needs and face similar challenges. In particular a continuing preference to formulate queries as Boolean expressions, the need to manage, organise and re-use search strategies and results and an ambivalence toward the use of relevance ranking. The results stress the importance of recall and coverage for the healthcare and patent professionals, while precision and recency were more important to the legal and recruitment professionals. The results also highlight the need to ensure that search systems give confidence to the professional searcher and so trust, explainability and accountability remains a significant challenge when developing such systems. The findings suggest that translational research between the different areas could benefit professionals across domains.  相似文献   

基于元数据的电子政务信息资源组织模式     

王红霞  苏新宁 《情报理论与实践》2007,30(1):116-121

在当今网络环境下,电子政务信息资源组织模式有效与否直接关系到信息资源的组织、管理和服务的效果。本文系统分析了目前信息资源组织4种基本模式的优点与不足,提出了基于元数据的信息资源组织模式,并对我国电子政务元数据标准的建立进行了思考。  相似文献   

把图书馆建设列入政绩考核     

罗绍权 《现代情报》2007,27(6):115-116,122

根据广东省有关文件，应把图书馆建设列入各级地方政府政绩考核范围，并议论了考核标准。  相似文献   

信息产业中制式选择问题研究   总被引：2，自引：0，他引：2  

王姣 《情报科学》2006,24(1):130-134

在现实中存在这样一种现象，同时出现两种版本，相互不兼容，但各有优劣，不能简单的评价哪个更好。我们称之为拥有不同的制式。但在竞争中，往往是由于一些非系统性的因素，使得其中的一个脱颖而出。本文旨在用博弈论的基本原理来解释形成这种选择的原因。  相似文献   

初解美国——美国英语中的隐喻     

李荆  韩伟 《现代情报》2006,26(11):218-219

本文从对大量已完全失去原有单词含义的美国英语日常用语分析理解入手，既让读者从一个侧面了解了美国英语的丰富多彩，又说明了语言并不是单一的技能训练。只有了解所学语言及其国家相关的文化和背荣知识，才能消除文化差异带来的语言障碍，从容跨过文化沟。  相似文献   

中国生态系统研究网络台站森林分布图编制规范及其制图的探讨     

邓坤枚 《资源科学》1997,19(1):61-66

本文阐述了研制“中国生态系统研究网络台站森林分布图编制范围”的重要意义与途径，同时，以鼎湖山站为例，依据“规范”对图例系统和森林分类  相似文献   

论设立大学科技园的标准   总被引：5，自引：0，他引：5  

夏劲  涂晶 《科学学研究》2005,23(2):204-207

针对大学科技园建设中存在的盲目扩建、片面追求数量和规模、科技成果转化率低、不良运作等问题,本文从建园的思想观念、管理体制和运作机制等方面分析了造成大学科技园建设重形式轻内容的原因,提出了设立大学科技园的项目标准、区位标准、能力标准、保障标准和人才储备标准。  相似文献   

资源集合元数据标准探析     

袁小一  俞毅 《情报理论与实践》2007,30(5):671-674

在数字图书馆建设过程中,资源集合无处不在,建立其元数据标准,是提供资源集合网上服务和数据交换的基础。本文分析了资源集合的概念、现有的资源集合元数据标准及资源集合与资源对象的关系,认为资源集合也是一种资源对象,从而提出可以采用适用于资源对象元数据标准的方法——元数据深度来分析资源集合,从而使资源集合元数据标准的建立更为简单化。  相似文献