Online Calibration of a Joint Model of Item Responses and Response Times in Computerized Adaptive Testing

Hyeon-Ah Kang, Yi Zheng and Hua-Hua Chang
Additional contact information
Hyeon-Ah Kang: University of Texas at Austin
Yi Zheng: Arizona State University
Hua-Hua Chang: Purdue University

Journal of Educational and Behavioral Statistics, 2020, vol. 45, issue 2, 175-208

Abstract: With the widespread use of computers in modern assessment, online calibration has become increasingly popular as a way of replenishing an item pool. The present study discusses online calibration strategies for a joint model of responses and response times. The study proposes likelihood inference methods for item paramter estimation and evaluates their performance along with optimal sampling procedures. An extensive simulation study indicates that the proposed online calibration strategies perform well with relatively small samples (e.g., 500∼800 examinees). The analysis of estimated parameters suggests that response time information can be used to improve the recovery of the response model parameters. Among a number of sampling methods investigated, A -optimal sampling was found most advantageous when the item parameters were weakly correlated. When the parameters were strongly correlated, D -optimal sampling tended to achieve the most accurate parameter recovery. The study provides guidelines for deciding sampling design under a specific goal of online calibration given the characteristics of field-testing items.

Keywords: online calibration; item response theory; response time; optimal sampling; computerized adaptive testing (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/1076998619879040 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:45:y:2020:i:2:p:175-208

DOI: 10.3102/1076998619879040

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().