Amazon Mechanical Turk Workers Can Provide Consistent and Economically Meaningful Data

David Johnson () and John Ryan

MPRA Paper from University Library of Munich, Germany

Abstract: We explore the consistency of the characteristics of individuals who participate in studies posted on Amazon Mechanical Turk (AMT). The primary individuals analyzed in this study are subjects who participated in at least two of eleven experiments that were run on AMT between September of 2012 to January of 2018. We demonstrate subjects consistently report a series of demographic and personality characteristics. Further, subjective willingness to take risk is found to be significantly correlated with decisions made in a simple lottery experiment with real stakes - even when the subjective risk measure is reported months, sometimes years, in the past. This suggests the quality of data obtained via AMT is not significantly harmed by the lack of control over the conditions under which the responses are recorded.

Keywords: Online Experiment; Risk; Consistency; Amazon Mechanical Turk; Experiment (search for similar items in EconPapers)
JEL-codes: C81 C89 C90 C99 (search for similar items in EconPapers)
Date: 2018-07-12
New Economics Papers: this item is included in nep-cbe and nep-exp
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
https://mpra.ub.uni-muenchen.de/88450/1/MPRA_paper_88450.pdf original version (application/pdf)

Related works:
Journal Article: Amazon Mechanical Turk workers can provide consistent and economically meaningful data (2020)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pra:mprapa:88450

Access Statistics for this paper

More papers in MPRA Paper from University Library of Munich, Germany Ludwigstraße 33, D-80539 Munich, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Joachim Winter ().