 Cognitive Effects of Inattentive Responding in an MTurk SampleJimin Pyo and Michael G. Maxfield Social Science Quarterly, 2021, vol. 102, issue 4, 2020-2039 Abstract: Objective Mechanical Turk (MTurk) has become an increasingly valuable sampling tool for social scientists. At the same time, concern has emerged about the quality of responses obtained from MTurk workers. This article demonstrates several screening practices for identifying problematic or inattentive MTurk participants. The study also examines how inattentive responding affects psychometric properties of measures and relationships between substantive variables. Method A sample of 498 MTurk workers participated in an experimental study for developing and validating scales of public confidence in the criminal justice system. Multiple screening procedures were used to identify inattentive participants and their potential effects on study measures and hypothesis testing. Results Results reveal adverse impacts on psychometric properties of measures as well as inflated observed relationships between substantive variables. Conclusion Screeners used in this study work well in identifying attention problems among MTurk participants. The present study expands guidance for improving quality of responses from MTurk participants for social science research. Date: 2021 Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:bla:socsci:v:102:y:2021:i:4:p:2020-2039 Ordering information: This journal article can be ordered from Access Statistics for this article Social Science Quarterly is currently edited by Robert L. Lineberry More articles in Social Science Quarterly from Southwestern Social Science Association |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.