Effect of Cognitive Pretests on Measurement Invariance and Reliability in Quality of Life Measures: An Evaluation in Refugee Studies

Natalja Menold ()
Additional contact information
Natalja Menold: Dresden University of Technology

Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, 2025, vol. 179, issue 1, No 20, 527-548

Abstract: Abstract The issue evaluated was how cross-cultural cognitive pretests affect the reliability and comparability of data when studying refugees and using cross-language comparisons. Three instruments employed to assess general and health-related quality of life were revised based on the findings of cognitive pretests. The versions before and after cognitive pretests were randomly assigned to respondents in two web survey studies. The first study recruited Arabic and Dari speaking refugees (N = 3448) via Facebook. The second study used a random sample (N = 610) of Arabic-speaking refugees and the German-speaking population. The comparability of data was evaluated by means of two popular measurement invariance analysis methods (exact and Bayesian measurement invariance analysis). These methods rely on factor analysis and thus enable the evaluation of the comparability of factor structure (configural invariance), the loadings or weights an item has on the factor (metric invariance), and the intercepts of an item on latent factor (scalar invariance). The revision of instruments on the basis of cognitive pretests primarily yielded positive outcomes with regard to reliability and cross-language comparability with respect to the factorial structure and loadings. However, the outcomes pertaining to scalar invariance were more equivocal. Cognitive pretests can therefore help to improve measurement quality, but further research is needed on the cross-cultural questionnaire design to make revisions with respect to cross-cultural comparability more conclusive.

Keywords: Methodology of cross-cultural measurement; Refugees; Comparability bias; Measurement invariance; Composite reliability (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11205-025-03622-w Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:soinre:v:179:y:2025:i:1:d:10.1007_s11205-025-03622-w

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11135

DOI: 10.1007/s11205-025-03622-w

Access Statistics for this article

Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement is currently edited by Filomena Maggino

More articles in Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().