A multi-group analysis of online survey respondent data quality: Comparing a regular USA consumer panel to MTurk samples
Scott M. Smith,
Catherine A. Roster,
Linda L. Golden and
Gerald S. Albaum
Journal of Business Research, 2016, vol. 69, issue 8, 3139-3148
Abstract:
With the exploding use of Internet surveys, research efforts and data quality are increasingly subject to the effects of respondents who do not give the required attention to survey questions and who speed through the survey, or who intentionally cheat with their answers. We investigate respondent integrity and data quality for samples drawn from a “Regular” online panel and from Amazon's MTurk. New metrics for assessing sample integrity and online data quality are introduced. Overall, MTurk respondents in both respondent groups took less time to answer questions. The non-USA MTurk group deviated most from correct answers in attention filter questions and had more duplicate IP addresses. In addition, the results from the three Internet sample sources are substantively different. The choice of an Internet survey sample vendor is critical, as it can impact sample composition, respondent integrity, data quality, data structure and substantive results.
Keywords: Consumer panels; Respondents; Data quality; Mechanical Turk; Internet surveys; Survey research (search for similar items in EconPapers)
Date: 2016
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (56)
Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S014829631500627X
Full text for ScienceDirect subscribers only
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:eee:jbrese:v:69:y:2016:i:8:p:3139-3148
DOI: 10.1016/j.jbusres.2015.12.002
Access Statistics for this article
Journal of Business Research is currently edited by A. G. Woodside
More articles in Journal of Business Research from Elsevier
Bibliographic data for series maintained by Catherine Liu ().