Classification/Decision Consistency Programs
BB-CLASS
BB-CLASS is an ANSI C computer program that uses the beta-binomial model (and its extensions) for estimating classification consistency and accuracy. BB-CLASS is intended to provide results for both the Hanson and Brennan (1990) and Livingston and Lewis (1995) procedures, although BB-CLASS has some capabilities that slightly extend these procedures. The BB-CLASS program, a manual, and the sample runs in the manual are provided.
- References
Hanson, B. A., & Brennan, R. L. (1990). An investigation of classification consistency indexes estimated under alternative strong true score models. Journal of Educational Measurement, 27, 345-359.
Livingston, S. A., & Lewis, C. (1995). Estimating the consistency and accuracy of classifications based on test scores. Journal of Educational Measurement, 32, 179-197.
MULT-CLASS
MULT-CLASS is a FORTRAN computer program that uses the compound multinomial model for estimating classification consistency and accuracy. MULT-CLASS is intended to provide results discussed in Lee (2005).
References
Lee, W. (2005, Revised 2008). Classification consistency and accuracy under the compound multinomial model (CASMA Research Report No. 13). Iowa City, IA: University of Iowa.
IRT-CLASS
IRT-CLASS is a PC console version of a FORTRAN computer program that computes classification consistency and accuracy indices for raw and scale scores. IRT-CLASS is intended to be used for tests that are scaled using dichotomous, polytomous, or mixtures of different IRT models.
Reference
Lee, W. (2008). Classification consistency and accuracy for complex assessments using item response theory (CASMA Research Report No. 27). Iowa City, IA: University of Iowa.
NM-CLASS
NM-CLASS is an R program that computes classification consistency and accuracy indices using the normal approximation procedure discussed in Peng and Subkoviak (1980)
References
Kim, S. Y., & Lee, W. (2019). Classification consistency and accuracy for mixed-format tests. Applied Measurement in Education, 32, 97-115.
Peng, C. J., & Subkoviak, M. J. (1980). A note on Huynh’s normal approximation procedure for estimating criterion-referenced reliability. Journal of Educational Measurement, 17, 359-368.