Can AI with High Reasoning Ability Replicate Human-like Decision Making in Economic Experiments?

Ayato Kitadai (), Sinndy Dayana Rico Lugo (), Yudai Tsurusaki (), Yusuke Fukasawa () and Nariaki Nishino ()
Additional contact information
Ayato Kitadai: The University of Tokyo
Sinndy Dayana Rico Lugo: Ritsumeikan Asia Pacific University
Yudai Tsurusaki: The University of Tokyo
Yusuke Fukasawa: The University of Tokyo
Nariaki Nishino: The University of Tokyo

Group Decision and Negotiation, 2025, vol. 34, issue 6, No 3, 1303-1326

Abstract: Abstract Economic experiments offer a controlled setting for researchers to observe human decision-making and test diverse theories and hypotheses; however, substantial costs and efforts are incurred to gather many individuals as experimental participants. To address this issue, with the development of large language models (LLMs), researchers have recently attempted to develop simulated economic experiments using LLMs-driven agents, called generative agents. If generative agents can replicate human-like decision making in economic experiments, the cost problem of economic experiments can be alleviated. However, despite growing attention, a structured methodology for reliably simulating human behavior using generative agents has not yet emerged. Considering previous research and the current evolutionary stage of LLMs, this study focuses on the reasoning ability of generative agents as a key factor in establishing a framework for this new methodology. A multi-agent simulation, designed to improve the reasoning ability of generative agents through prompting methods, was developed to reproduce the result of an actual economic experiment on the ultimatum game. The results demonstrated that the higher the reasoning ability of the agents, the closer the results were to the theoretical solution, rather than to the real experimental result. The results also suggest that setting the personas of the generative agents may be important for reproducing the results of real economic experiments. These findings provide a foundation for further studies aiming to develop scalable, interpretable, and context-aware LLM-based simulations for experimental economics.

Keywords: Large language models; Economic experiment; Multi agent simulation; Ultimatum game (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10726-025-09946-9 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:grdene:v:34:y:2025:i:6:d:10.1007_s10726-025-09946-9

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10726/PS2

DOI: 10.1007/s10726-025-09946-9

Access Statistics for this article

Group Decision and Negotiation is currently edited by Gregory E. Kersten

More articles in Group Decision and Negotiation from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().