Economics at your fingertips  

Does the use of mobile devices (tablets and smartphones) affect survey quality and choice behaviour in web surveys?

Ulf Liebe, Klaus Glenk, Malte Oehlmann and Jürgen Meyerhoff ()

Journal of choice modelling, 2015, vol. 14, issue C, 17-31

Abstract: Web surveys are becoming increasingly popular in survey research including stated preference surveys. Compared with face-to-face, telephone and mail surveys, web surveys may contain a different and new source of measurement error and bias: the type of device that respondents use to answer the survey questions. This is the first study that tests whether the use of mobile devices, tablets or smartphones, affects survey characteristics and stated preferences in a web-based choice experiment. The web survey on expanding renewable energy production in Germany was carried out with 3182 respondents, of which 12% used a mobile device. Propensity score matching is used to account for selection bias in the use of mobile devices for survey completion. We find that mobile device users spent more time than desktop/laptop users to answer the survey. Yet, desktop/laptop users and mobile device users do not differ in acquiescence tendency as an indicator of extreme response patterns. For mobile device users only, we find a negative correlation between screen size and interview length and a positive correlation between screen size and acquiescence tendency. In the choice experiment data, we do not find significant differences in the tendency to choose the status quo option and scale between both subsamples. However, some of the estimates of implicit prices differ, albeit not in a unidirectional fashion. Model results for mobile device users indicate a U-shaped relationship between error variance and screen size. Together, the results suggest that using mobile devices is not detrimental to survey quality.

Keywords: Acquiescence bias; Choice experiment; Mobile device; Propensity score matching; Renewable energy; Sample selection bias; Smartphone; Survey format; Survey quality (search for similar items in EconPapers)
Date: 2015
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (11) Track citations by RSS feed

Downloads: (external link)
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link:

DOI: 10.1016/j.jocm.2015.02.002

Access Statistics for this article

Journal of choice modelling is currently edited by S. Hess and J.M. Rose

More articles in Journal of choice modelling from Elsevier
Bibliographic data for series maintained by Catherine Liu ().

Page updated 2021-07-25
Handle: RePEc:eee:eejocm:v:14:y:2015:i:c:p:17-31