Using Item Scores and Distractors to Detect Item Compromise and Preknowledge

Kylie Gorney, James A. Wollack, Sandip Sinharay and Carol Eckerly
Additional contact information
James A. Wollack: University of Wisconsin-Madison
Carol Eckerly: Educational Testing Service

Journal of Educational and Behavioral Statistics, 2023, vol. 48, issue 5, 636-660

Abstract: Any time examinees have had access to items and/or answers prior to taking a test, the fairness of the test and validity of test score interpretations are threatened. Therefore, there is a high demand for procedures to detect both compromised items (CI) and examinees with preknowledge (EWP). In this article, we develop a procedure that uses item scores and distractors to simultaneously detect CI and EWP. The false positive rate and true positive rate are evaluated for both items and examinees using detailed simulations. A real data example is also provided using data from an information technology certification exam.

Keywords: item compromise; item preknowledge; test security; distractor analysis; nested logit model (search for similar items in EconPapers)
Date: 2023
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/10769986231159923 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:48:y:2023:i:5:p:636-660

DOI: 10.3102/10769986231159923

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().