Human Misperception of Generative-AI Alignment:A Laboratory Experiment

Kevin He (), Ran Shorrer () and Mengjia Xia ()
Additional contact information
Kevin He: University of Pennsylvania
Ran Shorrer: Pennsylvania State University
Mengjia Xia: University of Pennsylvania

PIER Working Paper Archive from Penn Institute for Economic Research, Department of Economics, University of Pennsylvania

Abstract: We conduct an incentivized laboratory experiment to study people’s perception of generative artificial intelligence (GenAI) alignment in the context of economic decisionmaking. Using a panel of economic problems spanning the domains of risk, time preference, social preference, and strategic interactions, we ask human subjects to make choices for themselves and to predict the choices made by GenAI on behalf of a human user. We find that people overestimate the degree of alignment between GenAI’s choices and human choices. In every problem, human subjects’ average prediction about GenAI’s choice is substantially closer to the average human-subject choice than it is to the GenAI choice. At the individual level, different subjects’ predictions about GenAI’s choice in a given problem are highly correlated with their own choices in the same problem. We explore the implications of people overestimating GenAI alignment in a simple theoretical model.

Pages: 51 pages
Date: 2025-04-06
New Economics Papers: this item is included in nep-cmp
References: Add references at CitEc
Citations:

Downloads: (external link)
https://economics.sas.upenn.edu/system/files/worki ... per%20Submission.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pen:papers:25-019

Access Statistics for this paper

More papers in PIER Working Paper Archive from Penn Institute for Economic Research, Department of Economics, University of Pennsylvania 133 South 36th Street, Philadelphia, PA 19104. Contact information at EDIRC.
Bibliographic data for series maintained by Administrator ().