Mixed-worded scales and acquiescence in educational large-scale assessments

Janine Buchholz

No 269, OECD Education Working Papers from OECD Publishing

Abstract: Self-report data such as those regularly administered with questionnaires in the OECD’s educational large-scale assessments are subject to response biases such as acquiescence, i.e., the tendency to agree with questionnaire items regardless their content. Research has shown that acquiescence affects the psychometric quality of such data, posing a threat to validity. Using a simple index that can be computed in the presence of both positively and negatively keyed items, the author examined the prevalence, the individual-level correlates, the impact on associations between indicators, as well as the county-level consistency of acquiescence for 16 questionnaires administered in four study programmes (PISA, TALIS, SSES, and IELS). Findings suggest that variation in acquiescence exists both between and within countries, the latter of which is determined by factors largely in line with prior research. Impact on associations as well as high levels of country-level consistency are evident. Based on these findings, recommendations for the construction of questionnaires to be administered in future assessments are derived.

Date: 2022-03-14
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://doi.org/10.1787/8dd310c0-en (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oec:eduaab:269-en

Access Statistics for this paper

More papers in OECD Education Working Papers from OECD Publishing Contact information at EDIRC.
Bibliographic data for series maintained by ().