Comparing advice on climate policy between academic experts and ChatGPT

Foroogh Salekpay, Jeroen van den Bergh and Ivan Savin

Ecological Economics, 2024, vol. 226, issue C

Abstract: We compare the results from a recent global expert survey on climate policy with answers to the same survey by the online artificial-intelligence chatbot ChatGPT. Such a study is timely and relevant as many people around the world are likely to use ChatGPT and similar language models to inquire about climate solutions, which in turn might influence public opinion. The comparison provides insights about performance criteria, policy instruments, and use of information from distinct academic disciplines. With a few exceptions, responses by ChatGPT are informative and of high quality. We find that ChatGPT answers questions with less bias than experts from various scientific disciplines. The latter may also be a disadvantage as it seems to weight all the information available equally without accounting well for relevance, which arguably may require human rather than artificial intelligence. On the other hand, experts from distinct disciplines show difference in average responses, with some even expressing opinions inconsistent with objective evidence, meaning there is no consistent and unbiased expert opinion on climate policy. As a new way of synthesizing large amounts of academic and grey literature, ChatGPT can serve policymaking. However, since the procedure that it follows for collecting and summarizing information remains a black box, it is best regarded as a complement rather than a substitute to traditional literature reviews and expert surveys.

Keywords: Artificial intelligence; Chatbot; Experts; Climate policy; Survey (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0921800924002490
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ecolec:v:226:y:2024:i:c:s0921800924002490

DOI: 10.1016/j.ecolecon.2024.108352

Access Statistics for this article

Ecological Economics is currently edited by C. J. Cleveland

More articles in Ecological Economics from Elsevier
Bibliographic data for series maintained by Catherine Liu ().