The Effect of Survey Mode on Data Quality: Disentangling Nonresponse and Measurement Error Bias

Felderer Barbara (), Kirchner Antje () and Kreuter Frauke ()
Additional contact information
Felderer Barbara: University of Mannheim, Mannheim, 68131, Germany.
Kirchner Antje: RTI International, 3040 E. Cornwallis Road, RTP, NC 27709, U.S.A.
Kreuter Frauke: University of Maryland, College Park, Maryland20742, U.S.A.

Journal of Official Statistics, 2019, vol. 35, issue 1, 93-115

Abstract: More and more surveys are conducted online. While web surveys are generally cheaper and tend to have lower measurement error in comparison to other survey modes, especially for sensitive questions, potential advantages might be offset by larger nonresponse bias. This article compares the data quality in a web survey administration to another common mode of survey administration, the telephone.The unique feature of this study is the availability of administrative records for all sampled individuals in combination with a random assignment of survey mode. This specific design allows us to investigate and compare potential bias in survey statistics due to 1) nonresponse error, 2) measurement error, and 3) combined bias of these two error sources and hence, an overall assessment of data quality for two common modes of survey administration, telephone and web.Our results show that overall mean estimates on the web are more biased compared to the telephone mode. Nonresponse and measurement bias tend to reinforce each other in both modes, with nonresponse bias being somewhat more pronounced in the web mode. While measurement error bias tends to be smaller in the web survey implementation, interestingly, our results also show that the web does not consistently outperform the telephone mode for sensitive questions.

Keywords: Mode effects; telephone survey; web survey; combined bias (search for similar items in EconPapers)
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://doi.org/10.2478/jos-2019-0005 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:vrs:offsta:v:35:y:2019:i:1:p:93-115:n:5

DOI: 10.2478/jos-2019-0005

Access Statistics for this article

Journal of Official Statistics is currently edited by Annica Isaksson and Ingegerd Jansson

More articles in Journal of Official Statistics from Sciendo
Bibliographic data for series maintained by Peter Golla ().