Examining How Professional Roles and Test Development Experiences Impact Angoff Ratings |
| |
| Authors: | Adam E Wyse |
| |
| Institution: | Psychometrics, Renaissance |
| |
| Abstract: | An important consideration in standard setting is recruiting a group of panelists with different experiences and backgrounds to serve on the standard-setting panel. This study uses data from 14 different Angoff standard settings from a variety of medical imaging credentialing programs to examine whether people with different professional roles and test development experiences tended to recommend higher or lower cut scores or were more or less accurate in their standard-setting judgments. Results suggested that there were not any statistically significant differences for different types of panelists in terms of the cut scores they recommended or the accuracy of their judgments. Discussion of what these results may mean for panelist selection and recruitment is provided. |
| |
| Keywords: | |
|
|
