Effects of Apophenia on Multiple-Choice Exam Performance

Stephen T. Paul, Samantha Monda, S. Maria Olausson and Brenna Reed-Daley

SAGE Open, 2014, vol. 4, issue 4, 2158244014556628

Abstract: There is a broad literature on the various issues related to effective exam construction applicable to both on-ground and online course delivery. These guidelines tend to support rather close contact between the instructor and the exam. However, to remain competitive, both textbook and course management providers have developed technologies to automate many aspects of exam construction. As test construction becomes automated, the possibility of inadvertently deviating from demonstrated or intuitive guidelines increases. Two experiments were conducted to examine the degree to which apophenia (perceiving patterns in random data) might negatively influence multiple-choice exam performance among college students. Experiment 1 indirectly demonstrated the extent to which certain answer patterns seemed to be tolerated among students (maximum of three repeated answers) in comparison with what might be expected from randomly generated exams from Blackboard. Experiment 2 directly examined the effects of answer patterns on exam performance. Participants’ performance declined as the underlying answer patterns became more obvious, and this effect appeared to be particularly strong for the upper level psychology students. The importance and implications of these findings with regard to automated test construction were discussed, and a recommendation is provided.

Keywords: apophenia; Blackboard; exam construction; multiple choice (search for similar items in EconPapers)
Date: 2014
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/2158244014556628 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:sagope:v:4:y:2014:i:4:p:2158244014556628

DOI: 10.1177/2158244014556628

Access Statistics for this article

More articles in SAGE Open
Bibliographic data for series maintained by SAGE Publications ().