Survey Mode Effects on Objective and Subjective Questions: Evidence from the Labour Force Survey

Schork Joachim (), Cesare Riillo and Neumayr Johann ()
Additional contact information
Schork Joachim: Statec Luxembourg, B.P. 304, L-2013 Luxembourg, 2013Luxembourg.
Neumayr Johann: Statec Luxembourg, B.P. 304, L-2013 Luxembourg, 2013Luxembourg.

Journal of Official Statistics, 2021, vol. 37, issue 1, 213-237

Abstract: Web questionnaires are increasingly used to complement traditional data collection in mixed mode surveys. However, the utilization of web data raises concerns whether web questionnaires lead to mode-specific measurement bias. We argue that the magnitude of measurement bias strongly depends on the content of a variable. Based on the Luxembourgish Labour Force Survey, we investigate differences between web and telephone data in terms of objective (i.e., Employment Status) and subjective (i.e., Wage Adequacy and Job Satisfaction) variables. To assess whether differences in outcome variables are caused by sample composition or mode-specific measurement bias, we apply a coarsened exact matching that approximates randomized experiments by reducing dissimilarities between web and telephone samples. We select matching variables with a combination of automatic variable selection via random forest and a literature-driven selection. The results show that objective variables are not affected by mode-specific measurement bias, but web participants report lower satisfaction-levels on subjective variables than telephone participants. Extensive supplementary analyses confirm our results. The present study supports the view that the impact of survey mode depends on the content of a survey and its variables.

Keywords: Web survey; telephone survey; mode effects; coarsened exact matching; measurement bias (search for similar items in EconPapers)
Date: 2021
References: Add references at CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://doi.org/10.2478/jos-2021-0009 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:vrs:offsta:v:37:y:2021:i:1:p:213-237:n:8

DOI: 10.2478/jos-2021-0009

Access Statistics for this article

Journal of Official Statistics is currently edited by Annica Isaksson and Ingegerd Jansson

More articles in Journal of Official Statistics from Sciendo
Bibliographic data for series maintained by Peter Golla ().