A Randomization P-Value Test for Detecting Copying on Multiple-Choice Exams

Joseph B. Lang
Additional contact information
Joseph B. Lang: University of Iowa

Journal of Educational and Behavioral Statistics, 2023, vol. 48, issue 3, 296-319

Abstract: This article is concerned with the statistical detection of copying on multiple-choice exams. As an alternative to existing permutation- and model-based copy-detection approaches, a simple randomization p -value (RP) test is proposed. The RP test, which is based on an intuitive match-score statistic, makes no assumptions about the distribution of examinees’ answer vectors and hence is broadly applicable. Especially important in this copy-detection setting, the RP test is shown to be exact in that its size is guaranteed to be no larger than a nominal α value. Additionally, simulation results suggest that the RP test is typically more powerful for copy detection than the existing approximate tests. The development of the RP test is based on the idea that the copy-detection problem can be recast as a causal inference and missing data problem. In particular, the observed data are viewed as a subset of a larger collection of potential values, or counterfactuals, and the null hypothesis of “no copying†is viewed as a “no causal effect†hypothesis and formally expressed in terms of constraints on potential variables.

Keywords: answer-copying indexes; causal inference; cheating; copying on multiple-choice exams; exact versus approximate tests; model-, permutation-, and randomization-based tests; nominal item response model; potential variables (search for similar items in EconPapers)
Date: 2023
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/10769986221143515 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:48:y:2023:i:3:p:296-319

DOI: 10.3102/10769986221143515

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().