Time-of-day and day-of-week variations in Amazon Mechanical Turk survey responses

Carola Binder

Journal of Macroeconomics, 2022, vol. 71, issue C

Abstract: Social science research studies are frequently conducted on Amazon Mechanical Turk (MTurk). I use data from four previous surveys of inflation expectations on MTurk, with a total of 2780 observations, to study how participant characteristics and behaviors depend on the day of the week and time of day of participation. Saturday participants are older, less educated, and more likely to have low income. Even controlling for demographics, Saturday participants are more likely to answer objective knowledge questions correctly and to provide reasonable inflation forecasts, and less likely to provide “don’t know” responses. They are also less likely to provide nonsensical responses when asked for open-ended comments. Time-of-day effects are less notable. Standard data cleaning procedures typically neither reduce nor exacerbate these patterns. I add data from several other studies in political science and psychology, and find similar Saturday effects with a sample size of over 8000. I discuss implications for various research designs, especially in macroeconomics applications.

Keywords: Amazon Mechanical Turk; Survey experiments; Intertemporal effects; Social sciences; Research methods and design; Data collection; Economics; Psychology; Political science; Crowdsourcing (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S016407042100077X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jmacro:v:71:y:2022:i:c:s016407042100077x

DOI: 10.1016/j.jmacro.2021.103378

Access Statistics for this article

Journal of Macroeconomics is currently edited by Douglas McMillin and Theodore Palivos

More articles in Journal of Macroeconomics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().