Investigation of Preknowledge Cheating via Joint Hierarchical Modeling Patterns of Response Accuracy and Response Time

Ebru Balta and Celal Deha Dogan

SAGE Open, 2024, vol. 14, issue 4, 21582440241297946

Abstract: As computer-based testing becomes more prevalent, the attention paid to response time (RT) in assessment practice and psychometric research correspondingly increases. This study explores the rate of Type I error in detecting preknowledge cheating behaviors, the power of the Kullback-Leibler (KL) divergence measure, and the L person fit statistic under various conditions by modeling patterns of response accuracy (RA) and RT using a joint hierarchical model. Four design factors were manipulated: test length, the difficulty level of compromised items, the ratio of compromised items, and variations in the RTs for these compromised items. The results indicate that the KL measure consistently exhibits higher power and Type I error rates than the person fit statistics L ( l s y ) and L ( l t ) across all RA and RT patterns and under all conditions. Furthermore, the KL measure demonstrates the greatest power at a medium test length.

Keywords: Kullback-Leibler divergence measure; joint modeling; person fit statistics; response times; response accuracy (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/21582440241297946 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:sagope:v:14:y:2024:i:4:p:21582440241297946

DOI: 10.1177/21582440241297946

Access Statistics for this article

More articles in SAGE Open
Bibliographic data for series maintained by SAGE Publications ().