Paid online convenience samples in gambling studies: questionable data quality

Dylan Pickering and Alex Blaszczynski

International Gambling Studies, 2021, vol. 21, issue 3, 516-536

Abstract: The use of non-probability Internet panels and crowdsource websites is increasing in gambling research. These paid online sampling methods offer a convenient and inexpensive recruitment strategy. The quality of data may be questionable due to careless responding and identity misrepresentation which can bias study results. It is necessary to investigate data quality given the important implications of gambling research in guiding policy decisions, public health initiatives, and treatments. In this review article, we 1) critically analyze the advantages and limitations of paid online recruitment methods, including associated threats to data quality in the gambling literature; 2) present findings from a rapid review of gambling studies using online panel and crowdsource data; and 3) outline recommendations for maximizing data quality and trustworthiness of findings. Substantially overinflated problem gambling rates were found in the 63 gambling studies we reviewed; less than one-quarter had incorporated data quality checks and reported participation rates. Future studies should incorporate pre-registration of methodology and analysis plans, robust participant screening procedures, mid-survey attention and response consistency items, and an analysis of response quality post data collection. Applying these recommendations to nonrepresentative online panel and crowdsource-based studies may enhance the replicability of findings in additional studies using representative samples

Date: 2021
References: Add references at CitEc
Citations: View citations in EconPapers (4)

Downloads: (external link)
http://hdl.handle.net/10.1080/14459795.2021.1884735 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:intgms:v:21:y:2021:i:3:p:516-536

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/RIGS20

DOI: 10.1080/14459795.2021.1884735

Access Statistics for this article

International Gambling Studies is currently edited by Katie Donnelly, David Marshall, Bronwyn Stuart, Alex Blaszczynski and Jan McMillen

More articles in International Gambling Studies from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().