Same Model, Different Politics? How Language Shapes AI Ideology

Eduardo Levy Yeyati, César M. Ciappa () and Milagros Onofri ()

School of Government Working Papers from Universidad Torcuato Di Tella

Abstract: Recent work measures ideological positioning and drift in large language models (LLMs), but typically assumes that those measurements are invariant to the language of evaluation. This paper tests that assumption using the full Political Compass questionnaire in English and Spanish across three generations of OpenAI models, together with a benchmark comparison against recent Qwen and Mistral releases. Using matched item-level responses, we estimate within-model Spanish–English displacement and assess how language choice affects cross-model comparisons. We find that measured ideological coordinates remain in the same broad region across languages, but are not language-invariant. Spanish–English shifts differ in sign and magnitude across models and axes, and in several cases amount to a substantial share of the inter-model dispersion typically interpreted as ideological drift in English-only audits. The implication is methodological: ideological drift should not be treated as a language-invariant property of a model, but as a measurement outcome conditional on language choice and instrument design. Multilingual audits should therefore report language-specific placements and within-model cross-language displacement rather than extrapolating from English-only measurements.

Keywords: large language models; ideological drift; multilingual evaluation; Political Compass; language dependence (search for similar items in EconPapers)
JEL-codes: C18 C83 C90 D72 (search for similar items in EconPapers)
Pages: 44 pages
Date: 2026-04
New Economics Papers: this item is included in nep-pol
References: Add references at CitEc
Citations:

Downloads: (external link)
https://repositorio.utdt.edu/handle/20.500.13098/14285 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:udt:wpgobi:wp_gob_2026_07

Access Statistics for this paper

More papers in School of Government Working Papers from Universidad Torcuato Di Tella
Bibliographic data for series maintained by Fiorela Navarro Duymovich ().