Automated Fact-Checking of Climate Change Claims with Large Language Models

Markus Leippold, Saeid Vaghefi, Veruska Muccione, Julia Bingler, Dominik Stammbach, Chiara Colesanti Senni, Jingwei Ni, Tobias Wekhof, Tingyu Yu, Tobias Schimanski, Glen Gostlow, Jürg Luterbacher and Christian Huggel
Additional contact information
Markus Leippold: University of Zurich; Swiss Finance Institute
Saeid Vaghefi: University of Zurich
Veruska Muccione: University of Zurich - Department of Geography; University of Geneva - Institute for Environmental Sciences
Julia Bingler: University of Oxford
Dominik Stammbach: ETH Zürich
Chiara Colesanti Senni: University of Zurich - Department of Finance
Jingwei Ni: ETH Zurich
Tobias Wekhof: ETH Zürich - CER-ETH - Center of Economic Research at ETH Zurich
Tingyu Yu: University of Zurich - Department Finance
Tobias Schimanski: University of Zurich
Glen Gostlow: University of Zurich - Department Finance
Jürg Luterbacher: World Health Organization (WHO) - World Health Organization, Geneva
Christian Huggel: University of Zurich

No 24-93, Swiss Finance Institute Research Paper Series from Swiss Finance Institute

Abstract: This paper presents Climinator, a novel AI-based tool designed to automate the fact-checking of climate change claims. Utilizing an array of Large Language Models (LLMs) informed by authoritative sources like the IPCC reports and peer-reviewed scientific literature, Climinator employs an innovative Mediator-Advocate framework. This design allows Climinator to effectively synthesize varying scientific perspectives, leading to robust, evidence-based evaluations. Our model demonstrates remarkable accuracy when testing claims collected from Climate Feedback and Skeptical Science. Notably, when integrating an advocate with a climate science denial perspective in our framework, Climinator's iterative debate process reliably converges towards scientific consensus, underscoring its adeptness at reconciling diverse viewpoints into science-based, factual conclusions. While our research is subject to certain limitations and necessitates careful interpretation, our approach holds significant potential. We hope to stimulate further research and encourage exploring its applicability in other contexts, including political fact-checking and legal domains.

Pages: 44 pages
Date: 2024-03
New Economics Papers: this item is included in nep-ain, nep-big and nep-env
References: Add references at CitEc
Citations:

Downloads: (external link)
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4731802 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:chf:rpseri:rp2493

Access Statistics for this paper

More papers in Swiss Finance Institute Research Paper Series from Swiss Finance Institute Contact information at EDIRC.
Bibliographic data for series maintained by Ridima Mittal ().