A Study of Discontinuity Effects in Regression Inference based on Web-Augmented Mixed Mode Surveys

Jan Pablo Burgard, Joscha Krause and Ralf Münnich

No 2020-03, Research Papers in Economics from University of Trier, Department of Economics

Abstract: We consider a situation where the sample design of a survey is modified over time in order to save resources. The former design is a classical large-scale survey. The new design is a mixed mode survey where a smaller classical sample is augmented by records of an online survey. For the online survey no inclusion probabilities are available. We study how this change of data collection affects regression coefficient estimation when the model remains constant in the population over time. Special emphasis is placed on situations where the online records are selective with respect to the model. We develop a statistical framework to quantify so-called survey discontinuities in regression analysis. The term refers to differences between coefficient estimates that solely stem from the survey redesign. For this purpose, we apply hypothesis tests to identify whether observed differences in estimates are significant. Further, we discuss propensity estimation and calibration as potential methods to reduce selection biases stemming from the web survey. A Monte Carlo simulation study is conducted to test the methods under different degrees of selectivity. We find that even mild informativeness significantly impairs regression inference relative to the former survey despite bias correction.

Keywords: Calibration; hypothesis test; informative sampling; propensity score estimation (search for similar items in EconPapers)
Pages: 19 pages
Date: 2020
New Economics Papers: this item is included in nep-ecm
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.uni-trier.de/fileadmin/fb4/prof/VWL/EWF/Research_Papers/2020-03.pdf First version, 2020 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:trr:wpaper:202003

Access Statistics for this paper

More papers in Research Papers in Economics from University of Trier, Department of Economics Contact information at EDIRC.
Bibliographic data for series maintained by Matthias Neuenkirch ().