Amazon Mechanical Turk workers can provide consistent and economically meaningful data

David Johnson () and John Barry Ryan

Southern Economic Journal, 2020, vol. 87, issue 1, 369-385

Abstract: Amazon Mechanical Turk (AMT) is an online labor market that is being used increasingly often in the social sciences. This occurs despite significant questions regarding efficacy of the platform. In this article, we attempt to address some of these questions by exploring the consistency of the characteristics of individuals who participate in studies posted on AMT. The primary individuals analyzed in this study are subjects who participated in at least two of eleven experiments that were run on AMT between September of 2012 and January of 2018. We demonstrate subjects consistently report their age, gender, subjective willingness to take risk, and impulsiveness. Further, subjective willingness to take risk is found to be significantly correlated with decisions made in a simple lottery experiment with real stakes—even when the subjective risk measure is reported months, sometimes years, in the past. This suggests the quality of data obtained via AMT is not terribly harmed by the lack of control and low stakes.

Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (17)

Downloads: (external link)
https://doi.org/10.1002/soej.12451

Related works:
Working Paper: Amazon Mechanical Turk Workers Can Provide Consistent and Economically Meaningful Data (2018)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:soecon:v:87:y:2020:i:1:p:369-385

Access Statistics for this article

More articles in Southern Economic Journal from John Wiley & Sons
Bibliographic data for series maintained by Wiley Content Delivery ().