A Comparative Study of Online Item Calibration Methods in Multidimensional Computerized Adaptive Testing

Ping Chen
Additional contact information
Ping Chen: Collaborative Innovation Center of Assessment toward Basic Education Quality, Beijing Normal University

Journal of Educational and Behavioral Statistics, 2017, vol. 42, issue 5, 559-590

Abstract: Calibration of new items online has been an important topic in item replenishment for multidimensional computerized adaptive testing (MCAT). Several online calibration methods have been proposed for MCAT, such as multidimensional “one expectation–maximization (EM) cycle†(M-OEM) and multidimensional “multiple EM cycles†(M-MEM). However, M-MEM often fails to converge when the correlations between dimensions are relatively high. To solve the nonconvergence issue and more accurately calibrate new items, this article combines Bayes modal estimation with M-OEM and M-MEM to make full use of the prior information from the item parameters of the new items. The obtained two new Bayesian methods were compared with the existing methods under several conditions, assuming the new items were assigned to examinees via random design or optimal Bayesian adaptive design. The simulation results showed that adding prior to the new item parameters was helpful to improve the calibration precision and efficiency of M-MEM but not so much for M-OEM, and the two online calibration designs exemplified very similar calibration precision.

Keywords: online calibration method; multidimensional computerized adaptive testing; Bayes modal estimation; multidimensional two-parameter logistic model; item replenishment (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/1076998617695098 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:42:y:2017:i:5:p:559-590

DOI: 10.3102/1076998617695098

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().