AI Reliance and Decision Quality: Fundamentals, Interdependence, and the Effects of Interventions

Jakob Schoeffer, Johannes Jakubik, Michael Vössing, Niklas Kühl and Gerhard Satzger

No cekm9, OSF Preprints from Center for Open Science

Abstract: In AI-assisted decision-making, a central promise of having a human-in-the-loop is that they should be able to complement the AI system by overriding its wrong recommendations. In practice, however, we often see that humans cannot assess the correctness of AI recommendations and, as a result, adhere to wrong or override correct advice. Different ways of relying on AI recommendations have immediate, yet distinct, implications for decision quality. Unfortunately, reliance and decision quality are often inappropriately conflated in the current literature on AI-assisted decision-making. In this work, we disentangle and formalize the relationship between reliance and decision quality, and we characterize the conditions under which human-AI complementarity is achievable. To illustrate how reliance and decision quality relate to one another, we propose a visual framework and demonstrate its usefulness for interpreting empirical findings, including the effects of interventions like explanations. Overall, our research highlights the importance of distinguishing between reliance behavior and decision quality in AI-assisted decision-making.

Date: 2024-08-25
New Economics Papers: this item is included in nep-ain
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://osf.io/download/66c7f5856e43e3b52adbecf9/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:osfxxx:cekm9

DOI: 10.31219/osf.io/cekm9

Access Statistics for this paper

More papers in OSF Preprints from Center for Open Science
Bibliographic data for series maintained by OSF ().