Can Internet Match High-quality Traditional Surveys? Comparing the Health and Retirement Study and its Online Version
Marco Angrisani (),
Brian Finley and
Arie Kapteyn ()
A chapter in The Econometrics of Complex Survey Data, 2019, vol. 39, pp 3-33 from Emerald Publishing Ltd
Abstract We examine sample characteristics and elicited survey measures of two studies, the Health and Retirement Study (HRS), where interviews are done either in person or by phone, and the Understanding America Study (UAS), where surveys are completed online and a replica of the HRS core questionnaire is administered. By considering variables in various domains, our investigation provides a comprehensive assessment of how Internet data collection compares to more traditional interview modes. We document clear demographic differences between the UAS and HRS samples in terms of age and education. Yet, sample weights correct for these discrepancies and allow one to satisfactorily match population benchmarks as far as key socio- demographic variables are concerned. Comparison of a variety of survey outcomes with population targets shows a strikingly good fit for both the HRS and the UAS. Outcome distributions in the HRS are only marginally closer to population targets than outcome distributions in the UAS. These patterns arise regardless of which variables are used to construct post-stratification weights in the UAS, confirming the robustness of these results. We find little evidence of mode effects when comparing the subjective measures of self-reported health and life satisfaction across interview modes. Specifically, we do not observe very clear primacy or recency effects for either health or life satisfaction. We do observe a significant social desirability effect, driven by the presence of an interviewer, as far as life satisfaction is concerned. By and large, our results suggest that Internet surveys can match high-quality traditional surveys.
Keywords: Online survey; survey methods; weighting; survey mode effects; face-to-face interviews; online interviews (search for similar items in EconPapers)
References: Add references at CitEc
Citations: View citations in EconPapers (2) Track citations by RSS feed
Downloads: (external link)
http://www.emeraldinsight.com/10.1108/S0731-905320 ... RePEc&WT.mc_id=RePEc (text/html)
Access to full text is restricted to subscribers
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:eme:aecozz:s0731-905320190000039001
Ordering information: This item can be ordered from
Emerald Group Publishing, Howard House, Wagon Lane, Bingley, BD16 1WA, UK
http://www.emeraldgr ... ies.htm?id=0731-9053
Access Statistics for this chapter
More chapters in Advances in Econometrics from Emerald Publishing Ltd
Bibliographic data for series maintained by Charlotte Maiorana ().