Development of a High-Accuracy and Effective Online Calibration Method in CD-CAT Based on Gini Index

Qingrong Tan, Yan Cai, Fen Luo and Dongbo Tu
Additional contact information
Qingrong Tan: Jiangxi Normal University
Dongbo Tu: Jiangxi Normal University

Journal of Educational and Behavioral Statistics, 2023, vol. 48, issue 1, 103-141

Abstract: To improve the calibration accuracy and calibration efficiency of cognitive diagnostic computerized adaptive testing (CD-CAT) for new items and, ultimately, contribute to the widespread application of CD-CAT in practice, the current article proposed a Gini-based online calibration method that can simultaneously calibrate the Q-matrix and item parameters of new items. Three simulation studies with simulated and real item banks were conducted to investigate the performance of the proposed method and compare it with the joint estimation algorithm (JEA) and the single-item estimation (SIE) methods. The results indicated that the proposed Gini-based online calibration method yielded higher calibration efficiency than those of the SIE method and outperformed the JEA method on item calibration tasks in terms of both accuracy and efficiency under most experimental conditions.

Keywords: cognitive diagnostic computerized adaptive testing; online calibration; Q-matrix; cognitive diagnosis models; Gini index (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/10769986221126741 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:48:y:2023:i:1:p:103-141

DOI: 10.3102/10769986221126741

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().