Multivariate assessment of interviewer-related errors in a cross-national economic survey (Lukas Olbrich, Elisabeth Beckmann, Joseph W. Sakshaug)

Elisabeth Beckmann, Lukas Olbrich () and Joseph Sakshaug
Additional contact information
Lukas Olbrich: Institute for Employment Research (IAB)
Joseph Sakshaug: University of Mannheim

Working Papers from Oesterreichische Nationalbank (Austrian Central Bank)

Abstract: Interviewers have long been identified as a source of error in face-to-face surveys. However, previous studies have typically focused on a single source of interviewer-related error and single-country cross-sectional surveys. We extend this literature by investigating the influence of interviewers from multiple dimensions in the Oesterreichische Nationalbank (OeNB) Euro Survey, a cross-national survey conducted annually in ten Central, Eastern, and Southeastern European countries. Using data from ten rounds (i.e., 100 country-years), we first analyze the extent of interviewer variance in financial literacy measures and how these effects compare to other questionnaire items. Building on the previous literature, we also evaluate the stability of these estimates over time and across countries. Second, we apply several data quality indicators on various dimensions of interviewer-related error and investigate country-years with particularly exceptional patterns. Finally, we use a multivariate tree-based outlier detection method (isolation forest) that flags country-years and interviewers with outlying values and combine it with methods from the interpretable machine learning literature to identify the respective exceptional feature values.

Keywords: interviewer effects; survey data quality; multilevel modeling; interviewer falsification; interviewer variance (search for similar items in EconPapers)
Pages: 55
Date: 2024-03-05
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.oenb.at/dam/jcr:072228b5-6cc5-49f1-8711-6b6db15973b4/wp-253.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:onb:oenbwp:253

Ordering information: This working paper can be ordered from
Oesterreichische Nationalbank, Economic Studies Division, POB 61, A-1011 Vienna, Austria

Access Statistics for this paper

More papers in Working Papers from Oesterreichische Nationalbank (Austrian Central Bank) P.O. Box 61, A-1011 Vienna, Austria. Contact information at EDIRC.
Bibliographic data for series maintained by Markus Knell ().