共查询到20条相似文献，搜索用时 31 毫秒
1.
Although textbooks on educational research give only scant attention to survey research methodology, its extensive use in education provides a strong rationale for improving the preparation of educational researchers in effectively applying survey methods. This study reviews methods for dealing with nonresponse bias, the primary problem presented by survey methods. It also provides an updated review of the literature of studies investigating the effectiveness of incentives to increase survey response rates. We hypothesized that a reanalysis of reviewed studies, using a linear trend test, would resolve the inconsistencies found regarding the effectiveness of incentives to increase response rates. The results of the reanalysis and guidelines for educational researchers in systematically selecting and applying incentives to increase response rates are discussed. 相似文献
2.
Gary R. Pike 《Research in higher education》2008,49(2):153-171
Weighting adjustments are used in some studies to compensate for biased estimators produced by survey nonresponse. Using data
from the 2004 National Survey of Student Engagement (NSSE) and the NSSE poststratification weighting algorithm, this study
found that weighting adjustments were needed for some, but not all institutions. Unfortunately, no simple criterion for determining
when weighting adjustments were needed could be identified. In addition, weighting adjustments reduced the precision of estimators
for a majority of the institutions. Based on these findings, institutions and researchers concerned about compensating for
nonresponse would be well advised to carefully evaluate the need for, and consequences of, weighting before employing weighting
adjustments. 相似文献
3.
Bruce W. Hartman Dale R. Fuqua Stephen J. Jenkins 《Journal of Experimental Education》2013,81(2):85-97
The detrimental effects of nonresponse bias are particularly significant given the widespread use of the survey data collection method in educational surveys. The authors explore and critique the current methods for remediating nonresponse bias in educational surveys. 相似文献
4.
This study uses college student survey data and corresponding administrative data on campus recreation facility usage, academic performance, physical education class attendance, and co-curricular participation to examine nonresponse bias in college student surveys. Within the context of the Groves (Public Opin Q 70:646–675, 2006) Alternative Cause Model, we found compelling evidence of the presence of nonresponse error observed as student characteristics related to the survey topic that also explain their response propensity. An individual’s survey response propensity has a statistically significant relationship with their actual behavior for 2 of 3 survey topics. In 11 of the 13 survey questions used to measure the survey topic behaviors, we found statistically significant differences between the respondent and nonrespondent behavioral measures. These findings hold important implications for survey researchers and those using student surveys for high-stakes accountability measures because survey summary statistics may not be generalizable to the target population.
相似文献5.
Using data collected as part of the second pilot administration of Your First College Year (YFCY), a national survey of first-year college students, this study was designed to examine both response rates and nonresponse bias across four survey administration groups: paper-only, paper with web option, web-only with response incentive, and web-only without response incentive. Findings indicate that response rates vary by mode of administration. Moreover, predictors of response differed by administration group. Results are discussed in light of the recent surge of interest in online survey research. 相似文献
6.
The problems of response bias in longitudinal studies of college students are examined. An extensive follow-up questionnaire was sent to 1,253 college seniors who had participated in a similar survey as freshman four years earlier. Careful measure of student responsiveness in relation to various techniques designed to increase the proportion of responders (e.g., postcard, telephone contact) were kept.The less responsive groups were significantly different from their more responsive counterparts on nearly a dozen variables representing a wide variety of content areas, including academic achievement, self-concept, alcohol consumption, social deviance, and major choice preferences. Controlling for sex and socioeconomic status served to reduce, but not eliminate, these biases. Overall, the results indicate that researchers cannot account for follow-up nonresponse bias by making statistical adjustments according to data available at initial testing. The results are discussed in light of identifying the reasons for nonresponse, and attempting to develop categories of nonresponders who may be motivated to cooperate by different types of follow-up techniques. 相似文献
7.
Daniel Y. Lee Jeffrey R. Harring Laura M. Stapleton 《Journal of Experimental Education》2013,81(4):596-615
Respondent attrition is a common problem in national longitudinal panel surveys. To make full use of the data, weights are provided to account for attrition. Weight adjustments are based on sampling design information and data from the base year; information from subsequent waves is typically not utilized. Alternative methods to address bias from nonresponse are full information maximum likelihood (FIML) or multiple imputation (MI). The effects on bias of growth parameter estimates from using these methods are compared via a simulation study. The results indicate that caution needs to be taken when utilizing panel weights when there is missing data, and to consider methods like FIML and MI, which are not as susceptible to the omission of important auxiliary variables. 相似文献
8.
Propensity score matching (PSM) has become a popular approach for research studies when randomization is infeasible. However, there are significant differences in the effectiveness of selection bias reduction among the existing PSM methods and, therefore, it is challenging for researchers to select an appropriate matching method. This current study compares four commonly used PSM methods for reducing selection bias on observational data from which the treatment effects are intended to be assessed. The selection bias, standardized bias and percent bias reduction are evaluated for each of the PSM methods using empirical data drawn from the national Education Longitudinal Study of 2002. The results of the current study provide empirical evidence and helpful information for researchers to select effective PSM methods for their research studies. 相似文献
9.
While many studies have examined nonresponse in student surveys, little research investigates why some schools achieve higher
student survey response rates than other schools. Using hierarchical linear modeling, we analyze survey data from 321 institutions
that participated in the 2003 National Survey of Student Engagement to understand how characteristics of colleges and universities
relate to student survey response rates. We find that the makeup of the student body, as well as institutional characteristics
such public/private status and urban location affects response rates, and that the number of computers per undergraduate has
a strong positive effect for web survey response rates. 相似文献
10.
Technological advances have enabled institutions of higher education to administer course evaluations online, forgoing the traditional paper-and-pencil methods. Consequently, many of these institutions suffer from low response rates, but little research is available on this topic. To increase understanding about course evaluation participation in the online environment, this study examined over 22,000 undergraduates to whom the university administered about 135,000 evaluations. Multilevel models were constructed to analyze the data, and several variables emerged as significant predictors of participation. The results were mostly consistent with previous research and aligned with theories of survey nonresponse. However, the integration of uncommon variables provided new perspectives about course evaluations in particular. Implications for research and practical applications for institutions are also addressed, including ways to combat survey fatigue, increase the salience of the survey, and increase participation in online course evaluations. 相似文献
11.
连续创业已成为高校毕业生的常态,对创业认知偏差与高校毕业生连续创业的关系进行探讨,有助于提升高校毕业生创业指导成效。基于创业认知理论,课题组以浙江金华、杭州地区350名连续创业者的调研数据为依托,探索创业者认知偏差对高校毕业生连续创业行为的作用关系。 相似文献
12.
项目无回答的成因与降低其水平的途径 总被引：2，自引：0，他引：2
严洁 《华中师范大学学报(人文社会科学版)》2006,45(6):58-63
本文基于两个全国概率抽样调查的实证数据,采用序列变量逻辑斯蒂回归和稳健回归的分析方法,探讨了在中国社会科学概率抽样调查中影响项目无回答的主要因素,结果发现受访人的受教育水平、城乡、地域属性和年龄是对无回答水平最稳定、最关键的影响因素。在控制了这些人群特征和题目的难度类型之后,测量指标的信度水平对无回答也具有显著的影响。根据分析结果,本文从实践的角度提出了有关降低项目无回答水平的建议。 相似文献
13.
Dealing With Item Nonresponse in Large‐Scale Cognitive Assessments: The Impact of Missing Data Methods on Estimated Explanatory Relationships 
下载免费PDF全文
下载免费PDF全文 Carmen Köhler Steffi Pohl Claus H. Carstensen 《Journal of Educational Measurement》2017,54(4):397-419
Competence data from low‐stakes educational large‐scale assessment studies allow for evaluating relationships between competencies and other variables. The impact of item‐level nonresponse has not been investigated with regard to statistics that determine the size of these relationships (e.g., correlations, regression coefficients). Classical approaches such as ignoring missing values or treating them as incorrect are currently applied in many large‐scale studies, while recent model‐based approaches that can account for nonignorable nonresponse have been developed. Estimates of item and person parameters have been demonstrated to be biased for classical approaches when missing data are missing not at random (MNAR). In our study, we focus on parameter estimates of the structural model (i.e., the true regression coefficient when regressing competence on an explanatory variable), simulating data according to various missing data mechanisms. We found that model‐based approaches and ignoring missing values performed well in retrieving regression coefficients even when we induced missing data that were MNAR. Treating missing values as incorrect responses can lead to substantial bias. We demonstrate the validity of our approach empirically and discuss the relevance of our results. 相似文献
14.
Robert A. Nathenson Jonathan Supovitz 《Journal of research on educational effectiveness》2019,12(2):307-331
Sample attrition increases the risk of statistical bias and hinders the ability to plausibly estimate causal effects when patterns of nonresponse are correlated with key variables of interest. Drawing on leverage-salience theory and other work in the behavioral psychology field, we empirically capture the impact of distinct motivational appeals on the survey response rates of elementary education teachers in a large urban school district in the northeastern United States. During spring 2017, teachers were randomized to receive one of six motivational appeals and were rerandomized to receive a different appeal each subsequent week, conditional on not having completed the survey. We observe the results on four different margins that range in their time intensity (open email and click, start, and complete survey). We find that extrinsic rewards improved teacher response across all four margins, and the social norm of reciprocity substantially improved teacher response along margins of lower time intensity. As researchers continue to conduct multitreatment arm studies and large-scale evaluations that can suffer from serious issues of sample attrition, this work highlights the contribution of message framing in survey response. 相似文献
15.
16.
Cynthia E. Hazel Daniel S. Newman Courtenay A. Barrett 《Journal of educational and psychological consultation》2016,26(2):111-138
The evidence base for school-based consultation practice and training is limited by a small number of studies, possibly due to unique challenges in researching consultation. For example, there are myriad variables to measure and idiosyncratic cultural and contextual factors to account for when investigating what works, for whom, and in what circumstances. Survey methodology offers one means for conducting consultation research. This article proposes a process for rigorous survey research in school-based consultation training and practice, which addresses some potential concerns regarding survey research. Specifically, issues of survey development, survey validation, sampling, and data collection are addressed. These processes are illustrated through the design and administration of an online survey of 262 early career school psychologists; preliminary data analyses suggested strong scale reliability, minimal item response bias, and population representativeness. Recommendations for future consultation survey research are provided. 相似文献
17.
BackgroundChild maltreatment research involves modeling complex relationships between multiple interrelated variables. Directed acyclic graphs (DAGs) are one tool child maltreatment researchers can use to think through relationships among the variables operative in a causal research question and to make decisions about the optimal analytic strategy to minimize potential sources of bias.ObjectiveThe purpose of this paper is to highlight the utility of DAGs for child maltreatment research and to provide a practical resource to facilitate and support the use of DAGs in child maltreatment research.ResultsWe first provide an overview of DAG terminology and concepts relevant to child maltreatment research. We describe DAG construction and define specific types of variables within the context of DAGs including confounders, mediators, and colliders, detailing the manner in which each type of variable can be used to inform study design and analysis. We then describe four specific scenarios in which DAGs may yield valuable insights for child maltreatment research: (1) identifying covariates to include in multivariable models to adjust for confounding; (2) identifying unintended effects of adjusting for a mediator; (3) identifying unintended effects of adjusting for multiple types of maltreatment; and (4) identifying potential selection bias in data specific to children involved in the child welfare system.ConclusionsOverall, DAGs have the potential to help strengthen and advance the child maltreatment research and practice agenda by increasing transparency about assumptions, illuminating potential sources of bias, and enhancing the interpretability of results for translation to evidence-based practice. 相似文献
18.
Serge Herzog 《Research in higher education》2018,59(3):273-301
Using data from two freshmen cohorts at a public research university (N = 3730), this study examines the relationship between loan aid and second-year enrollment persistence. Applying a counterfactual analytical framework that relies on propensity score (PS) weighting and matching to address selection bias associated with treatment status, the study estimates that loan aid exerts a significant negative effect on persistence for students from low-income background (i.e., Pell eligible), and those taking up high amounts of loans in order to meet total cost of attendance, including students who exhausted the available amount of subsidized loan aid. However, no significant incremental effect associated with unsubsidized loan aid, net of subsidized loan aid, could be detected. The estimated effect of loan aid on persistence controls for first-year academic experience and takes into account 26 factors related to loan selection and persistence in order to match students with loan aid to a counterfactual case in covariate adjusted regression. Comparison with results from non-matched-sample analysis suggests selection bias may mask the negative effect of loans detected with matched-sample estimation. Validity of covariates determining the loan selection process and criteria for acceptable balance in the matched data are discussed, and implications for future research are addressed. 相似文献
19.
Multiple matrix sampling procedures can be employed to improve survey research when the results of matrix sampling are equivalent to those obtained by the traditional census testing approach. This study examined the use of multiple matrix sampling as a strategy for the collection of data and compared rates of response when subgroups of items were administered as opposed to an entire instrument. In addition, the study investigated whether responses were equivalent in the two sampling procedures and whether bias was present. The results indicate that multiple matrix sampling is a viable and reasonable procedure to use when a mail survey questionnaire consists of a large number of pages and/or items. 相似文献
20.
Investigating the effectiveness of instructional practices provides an evidence base to inform instructional decisions. Synthesizing research studies on instructional effectiveness provides an estimate of the generalizability of effectiveness across settings, along with an exploration of factors that may moderate the impact, which cannot be achieved within individual studies. This study sought to provide a synthesis of evidence-based instructional practices (EBIPs) particular to chemistry through meta-analysis. Ninety-nine studies were analyzed comprising a broader view of chemistry specific studies than past meta-analyses. The results showed that EBIPs feature a demonstrably positive impact on students' academic performance in chemistry, although assessment topic coverage and setting size emerged as relevant moderators of impact and prevented making definitive conclusions of the relative impact of each EBIP. In examining publication bias, an asymmetric distribution of studies based on standard error (SE) and effect size was found, indicative of potential publication bias. To explore the potential impact of bias, the trim and fill method was employed resulting in a range for the overall weighted effect size from 0.29 to 0.62. The study concludes that evidence-based instructional practices have demonstrated effectiveness even in consideration of potential publication bias, as the range of effect sizes remains positive, but highlights the continued need to publish null findings in the research literature. 相似文献