首页 | 本学科首页   官方微博 | 高级检索  
相似文献
 共查询到20条相似文献，搜索用时 31 毫秒
1.
Multitrait-multimethod (MTMM) analyses are used in psychology to assess convergent and discriminant validity and to study method effects. Most current MTMM approaches assume that measures have equal convergent and discriminant validity across the entire range of trait values and thus do not account for potential trait × method interactions. A novel approach is presented that allows analyzing trait × method interactions using factor mixture modeling. The new MTMM mixture model allows identifying latent classes of individuals who differ with respect to convergent and discriminant validity. The new approach was applied to mother’s and father’s ratings of children’s attention deficit hyperactivity disorder (ADHD) symptoms (N = 618). Results revealed four latent classes: one with no symptom levels, two with low symptom levels, and one with moderate symptom levels. Three classes showed evidence for convergent and discriminant validity, whereas a low symptom class lacked convergent validity for ratings of inattention.

  相似文献   


2.
In this article we evaluate the psychometric properties of a scale for a perceptual measure of the extent to which manufacturing organizations develop proprietary equipment. We use a confirmatory factor analysis (CFA) approach to assess unidimensionality and reliability as well as convergent, discriminant and concurrent validity. Convergent and discriminant validity is assessed using CFA of the multitrait-multimethod (MTMM) matrix. In addition, we assess the scale's factorial invariance across industries. Results suggest that although method effects are present, the scale demonstrates internal consistency and validity. Implications of this study in the field of operations strategy and general strategy are discussed.  相似文献   

3.
In a recent article, Castro-Schilo, Widaman, and Grimm (2013) compared different approaches for relating multitrait–multimethod (MTMM) data to external variables. Castro-Schilo et al. reported that estimated associations with external variables were in part biased when either the correlated traits–correlated uniqueness (CT-CU) or correlated traits–correlated (methods–1) [CT-C(M–1)] models were fit to data generated from the correlated traits–correlated methods (CT-CM) model, whereas the data-generating CT-CM model accurately reproduced these associations. Castro-Schilo et al. argued that the CT-CM model adequately represents the data-generating mechanism in MTMM studies, whereas the CT-CU and CT-C(M–1) models do not fully represent the MTMM structure. In this comment, we question whether the CT-CM model is more plausible as a data-generating model for MTMM data than the CT-C(M–1) model. We show that the CT-C(M–1) model can be formulated as a reparameterization of a basic MTMM true score model that leads to a meaningful and parsimonious representation of MTMM data. We advocate the use confirmatory factor analysis MTMM models in which latent trait, method, and error variables are explicitly and constructively defined based on psychometric theory.  相似文献   

4.
A multiple-choice behavioral observation scale designed to be used by preschool teachers (N = 424) was factor analyzed to obtain factor coefficients. The four factors obtained were cognitive skills, self-control, relationship with achievement model, and dependency. The factor coefficients were then applied to the ratings of 153 preschool disadvantaged children by 33 teachers and 64 teacher aides. Three multi-trait, multi-rater matrices were analyzed using Campbell and Fiske’s convergent discriminant validation procedures. The analyses supported convergent and discriminant validity of three of the four traits.  相似文献   

5.
This study compared the Developmental Indicators for the Assessment of Learning—Revised (DIAL-R) and the Learning Accomplishment Profile—Diagnostic (LAP-D) for a sample of 121 children in an urban Head Start program. To examine validity, guidelines suggested by the multitrait-multimethod model (MTMM) were employed. The results indicated significant correlations between like-named scales, providing evidence for convergent validity. However, the within-method correlations often equaled or exceeded the validity coefficients, as did the between-method correlations of dissimilar scales. Thus the simultaneous requirements of both convergent and discriminant validity were not met. From the viewpoint of professional practices, the results suggest that profiles cannot be interpreted with confidence. New instruments and procedures are needed that reflect research and theory associated with the principles of psychosocial Change.  相似文献   

6.
This study compared the convergent and discriminant validity of two confidence marking techniques with that of conventional choice testing. Achievement in vocabulary, social studies, and science (traits) was measured by a 60-item test containing true-false and 5-alternative items (methods). The test was administered to three randomly assigned groups (one for each response system), totaling 535 Ss. The results indicated very slight differences in convergent and discriminant validity that favored conventional choice testing over confidence marking techniques.  相似文献   

7.
This article is about the analysis of the multitrait‐multimethod (MTMM) correlation matrix with the composite direct product model proposed by Browne (1984). Campbell and Fiske's (1959) criteria for convergent and discriminant validity have a direct interpretation in the composite direct product model. The model has a multiplicative property suggested as appropriate for MTMM correlation matrices by Campbell and O'Connell (1967, 1982), and it can be fitted to the correlation matrix by means of conventional software.  相似文献   

8.
The objectives of the study were to validate a substantiated Teacher Change Beliefs Model (TCBM) and an instrument to identify critical components of teacher change beliefs (TCB) in Malaysian secondary schools. Five different pilot test approaches were applied to ensure the validity and reliability of the instrument. A total of 936 teachers from 47 high-performing secondary schools completed the survey. Structural equation modelling was applied to test the models. Exploratory factor analysis was employed to identify the underlying factors, whereas confirmatory factor analysis was applied to test the measurement models. The analysis yielded a three-factor TCBM: (1) discrepancy, (2) efficacy and (3) principal support. The results demonstrated a good fit of the model: normed χ2 = 3.156, Tucker-Lewis Fix Index = .987, Comparative Fix Index = .991 and Root Mean Square Error of Approximation = .048. The results also provided evidence for convergent validity, discriminant validity and construct reliability. The TCBM is an empirically tested model derived in a local Malaysian cultural education setting. It provides direction for practitioners in planning and designing training programmes of change management for school principals in the enhancement of TCB among teachers in schools. Besides, Teacher Change Beliefs Scale is a promising and welcome tool for both practitioners and researchers. With only nine items, it is easy to administer and not time-consuming.  相似文献   

9.
The classic approach for partitioning and assessing reliability and validity has been through the use of the multitrait-multimethod (MTMM) model. The MTMM approach generally involves 3 different groups (method) evaluating 3 traits. This approach can be reconceptualized for questionnaire evaluation, so that the method becomes 3 different scaling types, which are administered to the same respondents on different occasions to avoid carryover effects. A serious limitation of this MTMM model is that data are required from respondents on at least 3 different occasions, thus placing a heavy burden on the researcher and respondents. Planned incomplete data designs for the purpose of substantially reducing the amount of data required for MTMM models were investigated: 1st, a design that reduces the amount of data collected at the 3rd administration by 22%; and 2nd, a design in which data need only be collected at 2 occasions. The performance of Listwise Deletion, Pairwise Deletion, and the expectation maximization (EM) algorithm at dealing with planned incomplete data are examined through a series of simulations. Results indicate that EM was generally precise and efficient.  相似文献   

10.
Simultaneous group confirmatory factor analyses of the Psychopathy Checklist‐Revised (PCL‐R; Hare, 1991) were conducted with an alcoholic inpatient sample (N= 740). Invariance of the item‐factor relations for the 2 highly correlated factors of Personality and Behavioral Features were supported across 3 racial/ethnic groups (African American, Puerto Rican, and White) and across gender groups. Moment structure analysis indicated no significant differences in the latent means across men and women. Alternative covariance structure models were specified within a multitrait‐multimethod framework to evaluate convergent and discriminant validity across different methods of measuring antisociality. A correlated trait‐correlated method model was supported. A factor intercorrelation of .68 was indicated for Personality and Behavioral Features, and a significant correlation (.40) among method factors emerged for the PCL‐R scores across different raters (interviewers and therapists). General support was provided for the use of the PCL‐R with alcoholic inpatients, though there was a substantial intercorrelation for the factors of Personality and Behavioral Features.  相似文献   

11.
Multisource feedback instruments are a widely used tool in human resource management. However, comprehensive validation studies remain scarce and there is a lack of statistical models that account appropriately for the complex data structure. Because both peers and subordinates are nested within the target but stem from different populations, the assumption of traditional multilevel structural equation models that the sample on a lower level stems from the same population is violated. We present a multilevel confirmatory factor analysis multitrait–multimethod (ML–CFA–MTMM) model that considers this peculiarity of multisource feedback instruments. The model is applied to 2 scales of the Benchmarks® instrument and it is demonstrated how measures of reliability and of convergent and discriminant validity can be obtained using multilevel structural equation modeling software. We discuss the results as well as some implications and guidelines for the use of the model.  相似文献   

12.
The convergent and discriminant validity of three measures of the concepts of aspiration level, ability, achievement, adjustment, and dominance were examined in the context of a multitrait-multimethod matrix. Self-reports and peer-reports on 75 Ss were employed as two measures of each trait. In addition, aspiration level was measured by the Edwards Personal Preference Schedule (EPPS) Nach scale, dominance by the EPPS (dom scale), achievement by cumulative college grade point ratio (GPR), ability by the Ohio State Psychological Examination (OSPE), and adjustment by the Bell Adjustment Inventory. Of the paper and pencil instruments, only the OSPE and EPPS (dominance scale) exhibited satisfactory convergent validity. No measure met all the requirements of discriminant validity. The desirability of establishing adequate validational evidence prior to using “trait” measures in studies relating theoretical variables was emphasized.  相似文献   

13.
The Narcissistic Personality Questionnaire for Children (NPQC) is a brief self‐report scale for measuring narcissism in children. In Study 1, a factor analysis on 370 children’s NPQC scores revealed four factors that were labeled superiority, exploitativeness, self‐absorption, and leadership. Study 2 established convergent and discriminant validities of the NPQC. NPQC scores were positively correlated with need for power/dominance, self‐esteem, aggression, and need for achievement, and unrelated to life satisfaction, as expected. Further support for the validity of the NPQC was obtained when findings were consistent with attachment theory’s interpretation of narcissistic children’s self‐perceptions. Study 3 investigated the temporal stability of scores. Results from Studies 1 and 3 show the NPQC to be an internally consistent measure (Cronbach alpha = .81) and to have adequate test–retest reliability (r = .81). Implications for the education of aggressive and narcissistic children are discussed.  相似文献   

14.
In this paper, we describe the Scientific Habits of Mind Survey (SHOMS) developed to explore public, science teachers’, and scientists’ understanding of habits of mind (HoM). The instrument contained 59 items, and captures the seven SHOM identified by Gauld. The SHOM was validated by administration to two cohorts of pre-service science teachers: primary science teachers with little science background or interest (n?=?145), and secondary school science teachers (who also were science graduates) with stronger science knowledge (n?=?145). Face validity was confirmed by the use of a panel of experts and a pilot study employing participants similar in demographics to the intended sample. To confirm convergent and discriminant validity, confirmatory factor analysis and evaluation of the reliability were calculated. Statistical data and other data gathered from interviews suggest that the SHOMS will prove to be a useful tool for educators and researchers who wish to investigate HoM for a variety of participants.  相似文献   

15.
Although the use of multiple criteria and informants is one of the most universally agreed on practices in the identification of gifted children, few studies to date have examined the convergent validity of multiple informants and objective ability tests in gifted identification. In this study, we illustrate the use of the correlated traits–correlated (methods – 1) or CT–C(M – 1) model (Eid, Lischetzke, Nussbeck, & Trierweiler, 2003) to examine the convergent validity of self, parent, and teacher ratings relative to objective cognitive ability tests in a sample of 145 4th to 6th graders. The CT–C(M – 1) analyses revealed that teacher ratings showed the highest convergence with the objective assessments, whereas self-ratings had the lowest reliabilities and insufficient validity. Parent ratings were more reliable and valid than self-reports, but were outperformed by teacher ratings for most abilities. Overall, the CT–C(M – 1) analyses showed that the convergent validity of the ratings relative to the objective test battery was highest for numerical and lowest for creative abilities. Furthermore, whereas part of the shared variance between parent and teacher ratings reflected true convergent validity, agreement between parent and self-reports was entirely due to a shared rater variance. Our analyses demonstrate the usefulness and proper interpretation of the CT–C(M – 1) approach for examining convergent validity and method effects in multitrait–multimethod data.  相似文献   

16.
This study examined the extent of measurement invariance of the Basic Psychological Needs in Exercise Scale responses (BPNES; Vlachopoulos & Michailidou, 2006) across male (n = 716) and female (n = 1,147) exercise participants. BPNES responses from exercise participants attending private fitness centers (n = 1,012) and community exercise programs (n = 851) were used. The 3-factor BPNES confirmatory factor analysis model, discriminant validity, and scale reliability were supported for both male and female participants separately. The multisample models supported the configural invariance, partial metric invariance, partial measurement error invariance, and partial scalar invariance of the BPNES responses across gender. Both male and female participants attached the same meaning to the constructs assessed by the BPNES items. The BPNES score invariance properties support tests of the needs universality hypothesis offered by self-determination theory across gender in exercise and meaningful comparison of the autonomy, competence, and relatedness construct latent means across gender.  相似文献   

17.
The study examined the convergent and discriminant validity of three methods for assessing three subskills of reading: word analysis, vocabulary, and comprehension. These three subskills were measured by teachers' ratings, specialists' ratings, and standardized tests. Correlations of all three skills, each measured by the three different methods, were studied by the multi-trait-multimethod procedure. Although there was some support for convergent validity, the study revealed a total lack of discriminant validity for any of the three subskills of reading.  相似文献   

18.
The article gives alternatives to Campbell and O'Connell's (1967) definitions of additive and multiplicative method effects in multitrait-multimethod (MTMM) data. The alternative definitions can be formulated by means of constraints in the parameters of the correlated uniqueness (CU) model (Marsh, 1989), which is first reviewed. The definitions have 2 major advantages. First, they allow the researcher to test for additive and multiplicative method effects in a straightforward manner by simply testing the appropriate constraints. An illustration of these tests is given. Second, the alternative definitions are closely linked to other currently used models. The article shows that CU models with additive constraints are equivalent to constrained versions of the confirmatory factor analysis model for MTMM data (Althauser, Heberlein, & Scott, 1971; Werts & Linn, 1970). In addition, Coenders and Saris (1998) showed that, for designs with 3 methods, a CU model with multiplicative constraints is equivalent to the direct product model (Browne, 1984).  相似文献   

19.
Emotion understanding develops rapidly in early childhood. Firstborn children (N = 231, 55% girls/45% boys, 86% White, 5% Black, 3% Asian, 4% Latinx, Mage = 29.92 months) were recruited into a longitudinal study from 2004 to 2008 in the United States and administered a series of tasks assessing eight components of young children's emotion understanding from ages 1 to 5. Cohort sequential analysis across three cohorts (1-, 2-, and 3-year-olds) demonstrated a progression of children's emotion understanding from basic emotion identification to an understanding of false-belief emotions, even after controlling for children's verbal ability. Emotion understanding scores were related to children's theory of mind and parent reports of empathy, but not emotional reactivity, providing evidence of both convergent and discriminant validity.  相似文献   

20.
This study is a methodological-substantive synergy, demonstrating the power and flexibility of exploratory structural equation modeling (ESEM) methods that integrate confirmatory and exploratory factor analyses (CFA and EFA), as applied to substantively important questions based on multidimentional students' evaluations of university teaching (SETs). For these data, there is a well established ESEM structure but typical CFA models do not fit the data and substantially inflate correlations among the nine SET factors (median rs = .34 for ESEM, .72 for CFA) in a way that undermines discriminant validity and usefulness as diagnostic feedback. A 13-model taxonomy of ESEM measurement invariance is proposed, showing complete invariance (factor loadings, factor correlations, item uniquenesses, item intercepts, latent means) over multiple groups based on the SETs collected in the first and second halves of a 13-year period. Fully latent ESEM growth models that unconfounded measurement error from communality showed almost no linear or quadratic effects over this 13-year period. Latent multiple indicators multiple causes models showed that relations with background variables (workload/difficulty, class size, prior subject interest, expected grades) were small in size and varied systematically for different ESEM SET factors, supporting their discriminant validity and a construct validity interpretation of the relations. A new approach to higher order ESEM was demonstrated, but was not fully appropriate for these data. Based on ESEM methodology, substantively important questions were addressed that could not be appropriately addressed with a traditional CFA approach.  相似文献   

设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号