Multimodal Likelihoods in Educational Assessment

Werner Wothke, George Burket, Li-Sue Chen, Furong Gao, Lianghua Shu and Mike Chia
Additional contact information
Werner Wothke: The American Institutes for Research
George Burket: Retired
Li-Sue Chen: eBay
Furong Gao: CTB/McGraw-Hill
Lianghua Shu: CTB/McGraw-Hill
Mike Chia: Consultant

Journal of Educational and Behavioral Statistics, 2011, vol. 36, issue 6, 736-754

Abstract: It has been known for some time that item response theory (IRT) models may exhibit a likelihood function of a respondent’s ability which may have multiple modes, flat modes, or both. These conditions, often associated with guessing of multiple-choice (MC) questions, can introduce uncertainty and bias to ability estimation by maximum likelihood (ML) when standard Newton solutions are used. This article evaluates the performance of several maximization methods, including initial (grid) searches probing the function slopes, simulated annealing, exhaustive likelihood evaluation, and the standard Newton algorithm. In extensive studies, involving several million records of both generated and real data, the algorithms were evaluated with respect to precision and speed. Two methods, exhaustive search and grid search, followed by Newton steps, all yielded ML estimates at the required precision. At today’s computer speeds, either of these algorithms may be considered for high-volume response pattern scoring.

Keywords: item response theory (IRT); psychometrics; assessment; statistics (search for similar items in EconPapers)
Date: 2011
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/1076998610381400 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:36:y:2011:i:6:p:736-754

DOI: 10.3102/1076998610381400

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().