Cognitive misers on the web: An online-experiment of incentives, cheating, and cognitive reflection

Jonas Ludwig and Anja Achtziger

Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), 2021, vol. 94, issue C

Abstract: The Cognitive Reflection Test (CRT) has become one of the most widely used psychological tests in decision research. It also acquired considerable fame in the news, social media, and classrooms around the globe. Given its popularity, it comes as no surprise that correct answers on the CRT questions can be easily found online. How does the availability of information about the test influence its validity as a measure of cognitive reflection, particularly, if it is deployed in an online study? We present evidence that participants searched for answers on the internet. We compared two CRT versions. The crucial difference was that correct responses could be easily found online for the standard CRT, but not its modified variant. In addition, we examined if performance-based payment affected test performance and participants’ propensity to cheat. The latter was operationalized as the online search for correct answers on the CRT questions. Our results suggested that cheating occurred during the experiment, and that doing so improved performance if correct responses were easily found on the web. When the CRT items were re-phrased so that they could not be found online, performance was not improved by incentives. Hence, incentives boosted cheating rather than cognitive reflection.

Keywords: Cognitive reflection test; Monetary incentives; Cheating (search for similar items in EconPapers)
Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S2214804321000719
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:soceco:v:94:y:2021:i:c:s2214804321000719

DOI: 10.1016/j.socec.2021.101731

Access Statistics for this article

Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics) is currently edited by Pablo Brañas Garza

More articles in Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics) from Elsevier
Bibliographic data for series maintained by Catherine Liu ().