A multi-group analysis of online survey respondent data quality: Comparing a regular USA consumer panel to MTurk samples

Scott M. Smith, Catherine A. Roster, Linda L. Golden and Gerald S. Albaum

Journal of Business Research, 2016, vol. 69, issue 8, 3139-3148

Abstract: With the exploding use of Internet surveys, research efforts and data quality are increasingly subject to the effects of respondents who do not give the required attention to survey questions and who speed through the survey, or who intentionally cheat with their answers. We investigate respondent integrity and data quality for samples drawn from a “Regular” online panel and from Amazon's MTurk. New metrics for assessing sample integrity and online data quality are introduced. Overall, MTurk respondents in both respondent groups took less time to answer questions. The non-USA MTurk group deviated most from correct answers in attention filter questions and had more duplicate IP addresses. In addition, the results from the three Internet sample sources are substantively different. The choice of an Internet survey sample vendor is critical, as it can impact sample composition, respondent integrity, data quality, data structure and substantive results.

Keywords: Consumer panels; Respondents; Data quality; Mechanical Turk; Internet surveys; Survey research (search for similar items in EconPapers)
Date: 2016
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (56)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S014829631500627X
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jbrese:v:69:y:2016:i:8:p:3139-3148

DOI: 10.1016/j.jbusres.2015.12.002

Access Statistics for this article

Journal of Business Research is currently edited by A. G. Woodside

More articles in Journal of Business Research from Elsevier
Bibliographic data for series maintained by Catherine Liu ().