How do individuals interact with an AI advisor in strategic reasoning? An experimental study in beauty contest

Daniela Di Cagno and Lihui Lin

Journal of Economic Behavior & Organization, 2025, vol. 237, issue C

Abstract: This paper experimentally investigates how individuals use generative AI to learn and respond in a strategic reasoning contest. An advisor based on level k theory and implemented using ChatGPT is introduced in a four-stage beauty contest experiment. The experiment is designed to explore how AI advisors influence the depth of human reasoning by shaping beliefs, learning, and sophisticated backward induction. Extended cognitive hierarchy models (Camerer et al., 2004) are applied to identify heterogeneous level distribution and more sophisticated thinking. Additionally, the interactions between participants with and without AI advisors are examined. Two key results emerge. First, individuals overestimate AI capabilities when competing against AI-guided participants, which motivates them to employ higher levels of thinking. This observed higher-level behaviour is driven by more sophisticated backward reasoning. Second, improved reasoning under AI guidance shows heterogeneous effects across Cognitive Reflection Test scores, suggesting that AI's impact depends on participants' pre-existing cognitive abilities. Overall, this early research provides insights into the interaction between generative AI and human cognition and reasoning.

Keywords: Level k; Beauty contest; Generative AI; Cognition and learning (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0167268125002781
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:jeborg:v:237:y:2025:i:c:s0167268125002781

DOI: 10.1016/j.jebo.2025.107159

Access Statistics for this article

Journal of Economic Behavior & Organization is currently edited by Houser, D. and Puzzello, D.

More articles in Journal of Economic Behavior & Organization from Elsevier
Bibliographic data for series maintained by Catherine Liu ().