Comparison of the quality estimates in a mixed-mode and a unimode design: an experiment from the European Social Survey

Melanie Revilla ()

Quality & Quantity: International Journal of Methodology, 2015, vol. 49, issue 3, 1219-1238

Abstract: In the frame of the European Social Survey (ESS), a series of experiments were conducted to investigate if and how the ESS might move from the single face-to-face survey to a mixed-mode design. In order to determine this, many aspects have to be considered. As the ESS wants to maintain the possibility to compare its data across countries and across time, one of the requirements to introduce a mixed-mode design is that it leads to a similar data quality as the current unimode face-to-face design. In this study, we define the quality as the strength of the relationship between the latent concept of interest and the observed answers. Analyzing the experiment done in parallel of the ESS round 6 (2012–2013) in Estonia and the UK, we find that the quality is similar in the unimode and mixed-mode designs, at least for given scales. This is true both for single items and for composite scores. Therefore, standardized relationships in the main ESS round 6 and the mixed-mode experiments can be compared. Besides, for the composite scores, we also find metric and scalar invariance, meaning that unstandardized relationships and means can be compared for the two concepts tested across the unimode and the mixed-mode designs too. Copyright Springer Science+Business Media Dordrecht 2015

Keywords: Mixed-mode surveys; Face-to-face interviews; Web surveys; Quality of questions; MultiTrait-MultiMethod (MTMM); Measurement equivalence (search for similar items in EconPapers)
Date: 2015
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://hdl.handle.net/10.1007/s11135-014-0044-5 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:qualqt:v:49:y:2015:i:3:p:1219-1238

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11135

DOI: 10.1007/s11135-014-0044-5

Access Statistics for this article

Quality & Quantity: International Journal of Methodology is currently edited by Vittorio Capecchi

More articles in Quality & Quantity: International Journal of Methodology from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().