Assessing Fit of Unidimensional Graded Response Models Using Bayesian Methods |
| |
| Authors: | Xiaowen Zhu Clement A Stone |
| |
| Institution: | 1. Data Recognition Corporation;2. University of Pittsburgh |
| |
| Abstract: | The posterior predictive model checking method is a flexible Bayesian model‐checking tool and has recently been used to assess fit of dichotomous IRT models. This paper extended previous research to polytomous IRT models. A simulation study was conducted to explore the performance of posterior predictive model checking in evaluating different aspects of fit for unidimensional graded response models. A variety of discrepancy measures (test‐level, item‐level, and pair‐wise measures) that reflected different threats to applications of graded IRT models to performance assessments were considered. Results showed that posterior predictive model checking exhibited adequate power in detecting different aspects of misfit for graded IRT models when appropriate discrepancy measures were used. Pair‐wise measures were found more powerful in detecting violations of the unidimensionality and local independence assumptions. |
| |
| Keywords: | |
|
