A Shadow-Test Approach to Adaptive Item Calibration

Wim J. van der Linden () and Bingnan Jiang
Additional contact information
Wim J. van der Linden: University of Twente
Bingnan Jiang: ACT, Inc.

Psychometrika, 2020, vol. 85, issue 2, No 3, 321 pages

Abstract: Abstract A shadow-test approach to the calibration of field-test items embedded in adaptive testing is presented. The objective function used in the shadow-test model selects both the operational and field-test items adaptively using a Bayesian version of the criterion of $$D_{\mathrm{s}}$$ D s -optimality. The constraint set for the model can be used to hide the field-test items completely in the content of the test as well as to deal with such practical issues as random control of their exposure rates. The approach runs on efficient implementations of the Gibbs sampler for the real-time updating of the ability and field-test parameters. Optimal settings for the proposed algorithms were found and used to demonstrate item calibration with smaller than traditional sample sizes in runtimes fully comparable with conventional adaptive testing.

Keywords: adaptive testing; Bayesian $$D_{\mathrm{s}}$$ D s -optimality; Gibbs sampling; item calibration; item response models; MCMC algorithm; shadow-test approach (search for similar items in EconPapers)
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://link.springer.com/10.1007/s11336-020-09703-8 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:psycho:v:85:y:2020:i:2:d:10.1007_s11336-020-09703-8

Ordering information: This journal article can be ordered from
http://www.springer. ... gy/journal/11336/PS2

DOI: 10.1007/s11336-020-09703-8

Access Statistics for this article

Psychometrika is currently edited by Irini Moustaki

More articles in Psychometrika from Springer, The Psychometric Society
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().