Social Reputation as one of the Key Driver of AI Over-Reliance: An Experimental Test with ChatGPT-3.5
Mathieu Chevrier
Additional contact information
Mathieu Chevrier: Université Côte d'Azur, CNRS, GREDEG, France
No 2025-12, GREDEG Working Papers from Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France
Abstract:
Understanding an agent's true competencies is crucial for a principal, particularly when delegating tasks. A principal may assign a task to an AI system, which is often perceived as highly competent, even in domains where its actual capabilities are limited. This experimental study demonstrates that participants mistakenly bet on ChatGPT-3.5's ability to solve mathematical tasks, even when explicitly informed that it only processes textual data. This overestimation leads participants to earn 67.2% less compared to those who rely on the competencies of another human. Overconfidence in ChatGPT-3.5 persists irrespective of task difficulty, time spent using ChatGPT-3.5, nor prior experience posing mathematical or counting questions to it mitigates this bias. I highlight that overconfidence in ChatGPT-3.5 is driven by the algorithm's social reputation. The more participants perceive ChatGPT-3.5 as socially trusted, the more they tend to rely on it.
Keywords: ChatGPT-3.5; Overconfidence; Competence; Social Reputation; Overreliance; Laboratory experiment (search for similar items in EconPapers)
JEL-codes: C92 D91 (search for similar items in EconPapers)
Pages: 13 pages
Date: 2025-04
References: Add references at CitEc
Citations:
Downloads: (external link)
http://195.220.190.85/GREDEG-WP-2025-12.pdf First version (application/pdf)
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:gre:wpaper:2025-12
Access Statistics for this paper
More papers in GREDEG Working Papers from Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France Contact information at EDIRC.
Bibliographic data for series maintained by Patrice Bougette ().