Showcasing the usefulness of web probing: Do subtle variations in questionnaire translation lead to different survey responding?

Dorothée Behr (), Michael Braun () and Luisa Aiglstorfer ()
Additional contact information
Dorothée Behr: GESIS - Leibniz Institute for the Social Sciences
Michael Braun: GESIS - Leibniz Institute for the Social Sciences
Luisa Aiglstorfer: GESIS - Leibniz Institute for the Social Sciences

Quality & Quantity: International Journal of Methodology, 2024, vol. 58, issue 5, No 5, 4117-4135

Abstract: Abstract It is generally taken for granted that comparability in comparative research hinges, among others, on the quality of questionnaire translations. However, what do slight differences in translation mean for respondents’ answers? In this article, we look at a combination of quantitative evidence from split-ballot experiments and qualitative evidence from additional probing questions for three items that were translated according to different translation methods, resulting in different translations, e.g., for “our national way of life.” Two of the three items do not show any quantitative differences between translation versions when implemented in split-ballot experiments. However, using open-ended probing questions we delved deeper into the effects of different translation versions. This allowed us to show that different translations do indeed change respondent understanding. We suggest mechanisms that may lead to different translations (not) having an impact on the data, and we also try to align the results to the notion of equivalence/comparability in translation. Ultimately, we showcase the usefulness of web probing for exploring different translation understandings.

Keywords: Questionnaire translation; Comparability; Cross-national research; Web-probing; Split-ballot (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s11135-024-01843-8 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:qualqt:v:58:y:2024:i:5:d:10.1007_s11135-024-01843-8

Ordering information: This journal article can be ordered from
http://www.springer.com/economics/journal/11135

DOI: 10.1007/s11135-024-01843-8

Access Statistics for this article

Quality & Quantity: International Journal of Methodology is currently edited by Vittorio Capecchi

More articles in Quality & Quantity: International Journal of Methodology from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().