Building a gold standard to construct search filters: a case study with biomarkers for oral cancer     

John J. Frazier  Corey D. Stein  Eugene Tseytlin  Tanja Bekhuis 《Journal of the Medical Library Association》2015,103(1):22-30

Objective:

To support clinical researchers, librarians and informationists may need search filters for particular tasks. Development of filters typically depends on a “gold standard” dataset. This paper describes generalizable methods for creating a gold standard to support future filter development and evaluation using oral squamous cell carcinoma (OSCC) as a case study. OSCC is the most common malignancy affecting the oral cavity. Investigation of biomarkers with potential prognostic utility is an active area of research in OSCC. The methods discussed here should be useful for designing quality search filters in similar domains.

Methods:

The authors searched MEDLINE for prognostic studies of OSCC, developed annotation guidelines for screeners, ran three calibration trials before annotating the remaining body of citations, and measured inter-annotator agreement (IAA).

Results:

We retrieved 1,818 citations. After calibration, we screened the remaining citations (n = 1,767; 97.2%); IAA was substantial (kappa = 0.76). The dataset has 497 (27.3%) citations representing OSCC studies of potential prognostic biomarkers.

Conclusions:

The gold standard dataset is likely to be high quality and useful for future development and evaluation of filters for OSCC studies of potential prognostic biomarkers.

Implications:

The methodology we used is generalizable to other domains requiring a reference standard to evaluate the performance of search filters. A gold standard is essential because the labels regarding relevance enable computation of diagnostic metrics, such as sensitivity and specificity. Librarians and informationists with data analysis skills could contribute to developing gold standard datasets and subsequent filters tuned for their patrons'' domains of interest.  相似文献   

Herrn Professor Edwin J. Houston,in Philadelphia     

Theodor Stein 《Journal of The Franklin Institute》1887,123(1):50-52

  相似文献   

Discovering physical abuse: insights from a follow-up study of delinquents.     

A Stein  D O Lewis 《Child abuse & neglect》1992,16(4):523-531

In a follow-up study of incarcerated Connecticut youth, 66 subjects participated in extensive personal interviews. This paper documents discrepancies between early data regarding abuse and retrospective self-reports of abuse given at the time of follow-up. It describes the development of an interview protocol in which inquiries regarding medical history, the general temperament of caretakers and their behaviors when intoxicated, and instruments and methods of punishment used in the home enabled subjects to describe abusive experiences not disclosed in response to direct questions about maltreatment. The paper also discusses the use of explicitly worded probes to flesh out a clear picture of subjects' experiences. The conflicts that underlie denial or minimization of abuse are discussed, along with interviewing strategies for overcoming them.  相似文献   

The revolutionary renewal of society in the German Democratic Republic and its consequences for higher‐level distance education     

Horst Möhle  Ruth Stein 《Distance Education》1990,11(2):254-265

  相似文献   

Hemispheric specialisation and dyslexia     

J. F. Stein 《Reading and writing》1991,3(3-4):435-440

  相似文献   

A Course in Engineering Measurements     

Stein  Peter K. 《Education, IRE Transactions on》1961,4(1):12-20

This paper describes the first course which engineering students at Arizona State University take in the field of measurements. This Senior course is part of the "core," i.e., it is taken by all engineering seniors (except electrical engineers who may take it as an elective subject).  相似文献   

The Cuckoo's Nest,the Banality of Evil and the Psychopath as Hero     

Howard F. Stein 《Journal of American culture (Malden, Mass. : 2003)》1980,2(4):635-645

  相似文献   

Longitudinal links between maternal cultural socialization,peer ethnic-racial discrimination,and ethnic-racial pride in Mexican American youth     

Gabriela Livas Stein  N. Keita Christophe  Laura Castro-Schilo  Casandra Gomez Alvarado  Richard Robins 《Child development》2023,94(3):752-767

This paper used cross-lagged panel models to test the longitudinal interplay between maternal cultural socialization, peer ethnic-racial discrimination, and ethnic-racial pride across 5th to 11th grade among Mexican American youth (N = 674, M_age = 10.86; 72% born in the United States; 50% girls; Wave 1 collected 2006–2008). Maternal cultural socialization predicted increases in subsequent youth ethnic-racial pride, and youth ethnic-racial pride prompted greater maternal cultural socialization. However, peer ethnic-racial discrimination was associated with subsequent decreases in ethnic-racial pride. The magnitude of these associations was consistent across 5th to 11th grades suggesting that maternal cultural socialization messages are necessary to maintain ethnic-racial pride across adolescence, thus families must continually support the development of ethnic-racial pride in their youth to counter the effects of discrimination.  相似文献   

A path analysis of basic need support,self-efficacy,achievement goals,life satisfaction and academic achievement level among secondary school students     

Åge Diseth  Anne G. Danielsen  Oddrun Samdal 《教育心理学》2012,32(3):335-354

Teachers’ support of basic psychological needs, self-efficacy, achievement goals, life satisfaction and academic achievement level was measured in a sample of 240 secondary school students (8th and 10th grades). Correlation analysis showed significant positive relations between all of the variables, except for the relation between need support of competence and performance goals. A subsequent path analysis showed that these variables could be accounted for by a structural model that described basic need support as predictors of self-efficacy and achievement goals, which in turn predicted academic achievement level and perceived life satisfaction. Analysis of intra-class correlation and design effect showed that need support of relatedness also was accounted for by class level responses. Theoretical and practical implications were discussed in terms of the importance of basic need support as a predictor of personal motives in educational settings as well as the students adjustment to school and life.  相似文献   

A Case Study of a Turnaround High School: An Examination of the Maryland State Department of Education Breakthrough Center Intervention     

Claudia Galindo  Kathleen Stein  Eugene Schaffer 《Journal of Education for Students Placed at Risk》2016,21(4):208-229

This study examined the Maryland State Department of Education Breakthrough Center (BTC) engagement in a Baltimore City turnaround high school. Utilizing a case-study design and mixed-methods research, data were collected through interviews, informal observations, and review of administrative and achievement documents. Beginning in the 2011–2012 academic year, the BTC has been working in collaboration with school personnel to improve the educational experiences and academic achievement of students. School personnel recognized that the BTC has been responsive to teachers' requests and has exhibited a flexible approach building collaborative and nonevaluative relations. Administrative and achievement data also indicated improvement in school outcome measures during the past 3 years. Nevertheless, school faculty also identified important challenges of the BTC intervention, such as the relevance of this intervention for veteran teachers, the extent to which the needs of all student populations were met, and the sustainability of the intervention.  相似文献