Reliability of educational attainment of survey respondents: an overlooked barrier to comparability?

Roberto Briceno-Rosas ()
Additional contact information
Roberto Briceno-Rosas: GESIS Leibniz Institute for the Social Sciences

Humanities and Social Sciences Communications, 2025, vol. 12, issue 1, 1-13

Abstract: Abstract Educational attainment is vital in social science research for analysing socioeconomic inequalities, labour market outcomes, and health disparities. Harmonisation schemes such as the International Standard Classification of Education (ISCED) and its survey-specific adaptation EDULVLB aim to standardise educational classifications across countries, enabling international comparability. Despite their widespread use, concerns persist regarding the reliability of these harmonised measures, particularly at the individual level and across different survey modes. This study evaluates the reliability of harmonised educational attainment measurements using test-retest data from Estonia, Slovenia, and the United Kingdom. Respondents’ answers from the face-to-face European Social Survey Round 8 (2016) and the online CRONOS Panel Wave 6 (2018) were analysed, with reliability coefficients estimated for both the one-digit ISCED and the more detailed EDULVLB classification. The results reveal notable individual-level inconsistencies, especially in the United Kingdom, challenging assumptions of high reliability in harmonised education data. Inconsistencies were most common between adjacent educational levels, suggesting difficulties distinguishing similar qualifications. Device effects were also observed, with smartphone users displaying lower consistency than computers or tablets users. While mode effects could not be fully disentangled from measurement error, the findings underscore the need for systematic reliability assessments and improved instrument design to ensure the comparability and validity of educational measures in cross-national survey research.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1057/s41599-025-06051-9 Abstract (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pal:palcom:v:12:y:2025:i:1:d:10.1057_s41599-025-06051-9

Ordering information: This journal article can be ordered from
https://www.nature.com/palcomms/about

DOI: 10.1057/s41599-025-06051-9

Access Statistics for this article

More articles in Humanities and Social Sciences Communications from Palgrave Macmillan
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().