首页 | 本学科首页   官方微博 | 高级检索  
相似文献
 共查询到20条相似文献，搜索用时 15 毫秒
1.
This study discusses the effects of oversimplifying the between-subject covariance structure on inferences for fixed effects in modeling nested data. Linear and quadratic growth curve models (GCMs) with both full and simplified between-subject covariance structures were fit to real longitudinal data. The results were contradictory to the statement that using oversimplified between-subject covariance structures (e.g., uni-level analysis) leads to underestimated standard errors of fixed effect estimates and thus inflated Type I error rates. We analytically derived simple mathematical forms to systematically examine the oversimplification effects for the linear GCMs. The derivation results were aligned with the real data analysis results and further revealed the conditions under which the standard errors of the fixed-effect intercept and slope estimates could be underestimated or overestimated for over-simplified linear GCMs. Therefore, our results showed that the underestimation statement is a myth and can be misleading. Implications are discussed and recommendations are provided.  相似文献   

2.
Abstract

Recently, researchers have used multilevel models for estimating intervention effects in single-case experiments that include replications across participants (e.g., multiple baseline designs) or for combining results across multiple single-case studies. Researchers estimating these multilevel models have primarily relied on restricted maximum likelihood (REML) techniques, but Bayesian approaches have also been suggested. The purpose of this Monte Carlo simulation study was to examine the impact of estimation method (REML versus Bayesian with noninformative priors) on the estimation of treatment effects (relative bias, root mean square error) and on the inferences about those effects (interval coverage) for autocorrelated multiple-baseline data. Simulated conditions varied with regard to the number of participants, series length, and distribution of the variance within and across participants. REML and Bayesian estimation led to estimates of the fixed effects that showed little to no bias but that differentially impacted the inferences about the fixed effects and the estimates of the variances. Implications for applied researchers and methodologists are discussed.  相似文献   

3.
The purpose of this simulation study was to assess the performance of latent variable models that take into account the complex sampling mechanism that often underlies data used in educational, psychological, and other social science research. Analyses were conducted using the multiple indicator multiple cause (MIMIC) model, which is a flexible and effective tool for relating observed and latent variables. The data were simulated in a hierarchical framework (e.g., individuals nested in schools) so that a multilevel modeling approach would be appropriate. Analyses were conducted accounting for and not accounting for the nested data to determine the impact of ignoring such multilevel data structures in full structural equation models. Results highlight the differences in modeling results when the analytic strategy is congruent with the data structure and what occurs when this congruency is absent. Type I error rates and power for the standard and multilevel methods were similar for within-cluster variables and for the multilevel model with between-cluster variables. However, Type I error rates were inflated for the standard approach when modeling between-cluster variables.  相似文献   

4.
This study examined the effects of ignoring multilevel data structures in nonhierarchical covariance modeling using a Monte Carlo simulation. Multilevel sample data were generated with respect to 3 design factors: (a) intraclass correlation, (b) group and member configuration, and (c) the models that underlie the between-group and within-group variance components associated with multilevel data. Covariance models that ignored the multilevel structure were then fit to the data. Results indicated that when variables exhibit minimal levels of intraclass correlation, the chi-square model/data fit statistic, the parameter estimators, and the standard error estimators are relatively unbiased. However, as the level of intraclass correlation increases, the chi-square statistic, the parameters, and their standard errors all exhibit estimation problems. The specific group/member configurations as well as the underlying between-group and within-group model structures further exacerbate the estimation problems encountered in the nonhierarchical analysis of multilevel data.  相似文献   

5.
We compared six common methods in estimating the 2-1-1 (level-2 independent, level-1 mediator, level-1 dependent) multilevel mediation model with a random slope. They were the Bayesian with informative priors, the Bayesian with non-informative priors, the Monte-Carlo, the distribution of the product, the bias-corrected, and the bias-uncorrected parametric percentile residual bootstrap. The Bayesian method with informative priors was superior in relative mean square error (RMSE), power, interval width, and interval imbalance. The prior variance and prior mean were also varied and examined. Decreasing the prior variance increased the power, reduced RMSE and interval width when the prior mean was the true value, but decreasing the prior variance reduced the power when the prior mean was set incorrectly. The influence of misspecification of prior information of the b coefficient on multilevel mediation analysis was greater than that on coefficient a. An illustrate example with the Bayesian multilevel mediation was provided.  相似文献   

6.
Many studies of changes in learning approaches have used data from different age groups at one point in time only (Gow and Kember, High Educ 19:307–322, 1990; Watkins and Hattie, Br J Educ Psychol 51:384–393, 1981) or have analyzed the effects of just two or three factors using single level analytical techniques (Cano, Br J Educ Psychol 75:203–221, 2005; Duckwall et al., Res High Educ 32(1):1–13, 1991; Jay and Love, NCSSSMST J 7(2):4–8, 2002; Loo, Educ Psychol, 17(1/2), 1997; Watkins and Hattie, Hum Learn 4:127–141, 1985; Zeegers, Br J Educ Psychol 71:115–132, 2001). This study employs multilevel modeling as a more appropriate technique for the analysis of longitudinal data to examine factors influencing changes in the learning approaches of 153 international undergraduate students over a 3-year period. Specifically, using hierarchical linear modeling (HLM), the effects of personal values (level-2) on learning approaches and changes in them over time (level-1) are examined. Results show no changes within students in the deep and surface approaches to learning but a significant decline for the achieving approach, particularly for students who previously experienced a more formal teaching authority. Furthermore, students’ personal values in terms of security, achievement and hedonism affect the achieving approach while no effects emerge for the personal values of tradition, conformity, universalism, self-direction and stimulation. Finally, these effects can be observed while no significant effects emerge for gender, discipline and ability.  相似文献   

7.
SIBTEST is a differential item functioning (DIF) detection method that is accurate and effective with small samples, in the presence of group mean differences, and for assessment of both uniform and nonuniform DIF. The presence of multilevel data with DIF detection has received increased attention. Ignoring such structure can inflate Type I error. This simulation study examines the performance of newly developed multilevel adaptations of SIBTEST in the presence of multilevel data. Data were simulated in a multilevel framework and both uniform and nonuniform DIF were assessed. Study results demonstrated that naïve SIBTEST and Crossing SIBTEST, ignoring the multilevel data structure, yield inflated Type I error rates, while certain multilevel extensions provided better error and accuracy control.  相似文献   

8.
Although structural equation modeling (SEM) is one of the most comprehensive and flexible approaches to data analysis currently available, it is nonetheless prone to researcher misuse and misconceptions. This article offers a brief overview of the unique capabilities of SEM and discusses common sources of user error in drawing conclusions from these analyses. We make recommendations to guide proper analytical practices and appropriate inferences and provide references for more advanced study. © 2007 Wiley Periodicals, Inc. Psychol Schs 44: 461–470, 2007.  相似文献   

9.
Conventional multilevel modeling works well with purely hierarchical data; however, pure hierarchies rarely exist in real datasets. Applied researchers employ ad hoc procedures to create purely hierarchical data. For example, applied educational researchers either delete mobile participants' data from the analysis or identify the student only with the last school attended while including an explanatory variable indicating whether a student is mobile. This simulation study compared the parameter and standard error estimates of these two ad hoc procedures for handling and assessing the influence of mobility on outcomes with results based on use of the multiple membership random effects model. Substantial bias was found for some parameters when multiple membership data structures were ignored.  相似文献   

10.
The purpose of this study was to examine the performance of differential item functioning (DIF) assessment in the presence of a multilevel structure that often underlies data from large-scale testing programs. Analyses were conducted using logistic regression (LR), a popular, flexible, and effective tool for DIF detection. Data were simulated using a hierarchical framework, such as might be seen when examinees are clustered in schools, for example. Both standard and hierarchical LR (accounting for multilevel data) approaches to DIF detection were employed. Results highlight the differences in DIF detection rates when the analytic strategy matches the data structure. Specifically, when the grouping variable was within clusters, LR and HLR performed similarly in terms of Type I error control and power. However, when the grouping variable was between clusters, LR failed to maintain the nominal Type I error rate of .05. HLR was able to maintain this rate. However, power for HLR tended to be low under many conditions in the between cluster variable case.  相似文献   

11.
Editor's note     
This article provides a didactic example and application of new developments in structural equation modeling (SEM) that allow for the modeling of multilevel data. Such data often arise naturally from organizational structures in which within‐group units (employees, students, etc.) are observed in larger between‐group units (firms, schools, etc.) The article begins with an overview of the basic ideas of SEM and multilevel linear regression. The synthesis of both methods developed by Muthéin (1994) is then presented in the simple case of a multilevel path analysis model, in which the variations in within‐group level intercepts are modeled as a function of between‐group variables following their own path model. An application motivated by a real problem in the field of education that focuses on validating indicators of the quality of science education in the United States follows. The results show that it is possible to statistically capture the salient complexities of organizations through the application of multilevel SEM. The article concludes with a discussion of the utility of multilevel SEM for organizational studies.  相似文献   

12.
The inclusion of covariates improves the prediction of class memberships in latent class analysis (LCA). Several methods for examining covariate effects have been developed over the past decade; however, researchers have limited to the comparisons of the performance among these methods in cases of the single-level LCA. The present study investigated the performance of three different methods for examining covariate effects in a multilevel setting. We conducted a simulation to compare the performance of the three methods when level-1 and level-2 covariates were simultaneously incorporated into the nonparametric multilevel latent class model to predict latent class membership at each level. The simulation results revealed that the bias-adjusted three-step maximum likelihood method performed equally well as the one-step method when the sample sizes were sufficiently large and the latent classes were distinct from each other. However, the unadjusted three-step method significantly underestimated the level-1 covariate effect in most conditions.

  相似文献   


13.
In many applications of multilevel modeling, group-level (L2) variables for assessing group-level effects are generated by aggregating variables from a lower level (L1). However, the observed group mean might not be a reliable measure of the unobserved true group mean. In this article, we propose a Bayesian approach for estimating a multilevel latent contextual model that corrects for measurement error and sampling error (i.e., sampling only a small number of L1 units from a L2 unit) when estimating group-level effects of aggregated L1 variables. Two simulation studies were conducted to compare the Bayesian approach with the maximum likelihood approach implemented in Mplus. The Bayesian approach showed fewer estimation problems (e.g., inadmissible solutions) and more accurate estimates of the group-level effect than the maximum likelihood approach under problematic conditions (i.e., small number of groups, predictor variable with a small intraclass correlation). An application from educational psychology is used to illustrate the different estimation approaches.  相似文献   

14.
Over the past decade and a half, methodologists working with structural equation modeling (SEM) have developed approaches for accommodating multilevel data. These approaches are particularly helpful when modeling data that come from complex sampling designs. However, most data sets that are associated with complex sampling designs also include observation weights, and methods to incorporate these sampling weights into multilevel SEM analyses have not been addressed. This article investigates the use of different weighting techniques and finds, through a simulation study, that the use of an effective sample size weight provides unbiased estimates of key parameters and their sampling variances. Also, a popular normalization technique of scaling weights to reflect the actual sample size is shown to produce negatively biased sampling variance estimates, as well as negatively biased within-group variance parameter estimates in the small group size case.  相似文献   

15.
The design of research studies utilizing binary multilevel models must necessarily incorporate knowledge of multiple factors, including estimation method, variance component size, or number of predictors, in addition to sample sizes. This Monte Carlo study examined the performance of random effect binary outcome multilevel models under varying methods of estimation, level-1 and level-2 sample size, outcome prevalence, variance component sizes, and number of predictors using SAS software. Mean estimates of statistical power were influenced primarily by sample sizes at both levels. In addition, confidence interval coverage and width and the likelihood of nonpositive definite random effect covariance matrices were impacted by variance component size and estimation method. The interactions of these and other factors with various model performance outcomes are explored.  相似文献   

16.
Although methodology articles have increasingly emphasized the need to analyze data from two members of a dyad simultaneously, the most popular method in substantive applications is to examine dyad members separately. This might be due to the underappreciation of the extra information simultaneous modeling strategies can provide. Therefore, the goal of this study was to compare multiple growth curve modeling approaches for longitudinal dyadic data (LDD) in both structural equation modeling and multilevel modeling frameworks. Models separately assessing change over time for distinguishable dyad members are compared to simultaneous models fitted to LDD from both dyad members. Furthermore, we compared the simultaneous default versus dependent approaches (whether dyad pairs’ Level 1 [or unique] residuals are allowed to covary and differ in variance). Results indicated that estimates of variance and covariance components led to conflicting results. We recommend the simultaneous dependent approach for inferring differences in change over time within a dyad.  相似文献   

17.
Abstract

Applied researchers often find themselves making statistical inferences in settings that would seem to require multiple comparisons adjustments. We challenge the Type I error paradigm that underlies these corrections. Moreover we posit that the problem of multiple comparisons can disappear entirely when viewed from a hierarchical Bayesian perspective. We propose building multilevel models in the settings where multiple comparisons arise. Multilevel models perform partial pooling (shifting estimates toward each other), whereas classical procedures typically keep the centers of intervals stationary, adjusting for multiple comparisons by making the intervals wider (or, equivalently, adjusting the p values corresponding to intervals of fixed width). Thus, multilevel models address the multiple comparisons problem and also yield more efficient estimates, especially in settings with low group-level variation, which is where multiple comparisons are a particular concern.  相似文献   

18.
Multilevel modeling has grown in use over the years as a way to deal with the nonindependent nature of observations found in clustered data. However, other alternatives to multilevel modeling are available that can account for observations nested within clusters, including the use of Taylor series linearization for variance estimation, the design effect adjusted standard errors approach, and fixed effects modeling. Using 1,000 replications of 12 conditions with varied Level 1 and Level 2 sample sizes, the author compared parameter estimates, standard errors, and statistical significance using various alternative procedures. Results indicate that several acceptable procedures can be used in lieu of or together with multilevel modeling, depending on the type of research question asked and the number of clusters under investigation. Guidelines for applied researchers are discussed.  相似文献   

19.
Abstract

Field experiments that involve nested structures frequently assign treatment conditions to entire groups (such as schools). A key aspect of the design of such experiments includes knowledge of the clustering effects that are often expressed via intraclass correlation. This study provides methods for constructing a more powerful test for the treatment effect in three-level cluster randomized designs with two levels of nesting (at the second and third levels). When the intraclass correlation structure at the second and third level is assumed to be known, the proposed test provides higher estimates of power than those obtained from the typical test based on level-3 unit means, because it preserves the degrees of freedom associated with the number of level-2 and level-1 units. The advantage in power estimates is more pronounced when the number of level-3 units (e.g., schools) is small and the samples are homogeneous (e.g., low-achieving schools).  相似文献   

20.
The current simulation study examined the effects of Item Parameter Drift (IPD) occurring in a short scale on parameter estimates in multilevel models where scores from a scale were employed as a time-varying predictor to account for outcome scores. Five factors, including three decisions about IPD, were considered for simulation conditions. It was revealed that IPD occurring in a relatively shorter scale led to a substantial increase in the amount of relative bias in parameter estimates. The bias was more prominent in the estimates of level-2 time-varying predictors relative to those of level-1 time-varying predictors. Regarding the decisions about IPD, keeping items exhibiting IPD was more appropriate than removing them based on the results from relative bias of standard errors of estimates. Based on the findings, it can be concluded that removing items exhibiting IPD may lead to an increase of Type II errors due to the underestimation of parameter estimates and overestimation of standard errors. The applied example showed findings consistent with those in the simulation study.  相似文献   

设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号