Political Bias in Large Language Models: A Comparative Analysis of ChatGPT-4, Perplexity, Google Gemini, and Claude

Tavishi Choudhary ()
Additional contact information
Tavishi Choudhary: Greenwich High, Greenwich, Connecticut, US

RAIS Conference Proceedings 2022-2024 from Research Association for Interdisciplinary Studies

Abstract: Artificial Intelligence large language models have rapidly gained widespread adoption, sparking discussions on their societal and political impact, especially for political bias and its far-reaching consequences on society and citizens. This study explores the political bias in large language models by conducting a comparative analysis across four popular AI mod-els—ChatGPT-4, Perplexity, Google Gemini, and Claude. This research systematically evaluates their responses to politically charged prompts and questions from the Pew Research Center’s Political Typology Quiz, Political Compass Quiz, and ISideWith Quiz. The findings revealed that ChatGPT-4 and Claude exhibit a liberal bias, Perplexity is more conservative, while Google Gemini adopts more centrist stances based on their training data sets. The presence of such biases underscores the critical need for transparency in AI development and the incorporation of diverse training datasets, regular audits, and user education to mitigate any of these biases. The most significant question surrounding political bias in AI is its consequences, particularly its influence on public discourse, policy-making, and democratic processes. The results of this study advocate for ethical implications for the development of AI models and the need for transparency to build trust and integrity in AI models. Additionally, future research directions have been outlined to explore and address the complex AI bias issue.

Keywords: Large language models (LLM); Generative AI (GenAI); AI Governance and Policy; Ethical AI Systems (search for similar items in EconPapers)
Pages: 14 pages
Date: 2024-08
New Economics Papers: this item is included in nep-ain, nep-big, nep-cmp and nep-pol
References: View references in EconPapers View complete reference list from CitEc
Citations:

Published in Proceedings of the 37th International RAIS Conference on Social Sciences and Humanities, August 8-9, 2024, vol. 2, pages 176-209

Downloads: (external link)
https://rais.education/wp-content/uploads/2024/10/0451.pdf Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:smo:raiswp:0451

Access Statistics for this paper

More papers in RAIS Conference Proceedings 2022-2024 from Research Association for Interdisciplinary Studies
Bibliographic data for series maintained by Eduard David ().