Advisory algorithms, automation bias and liability rules

Marie Obidzinski () and Yves Oytana ()
Additional contact information
Marie Obidzinski: Université Paris Panthéon Assas, CRED UR 7321, F-75005 Paris, France
Yves Oytana: Université Marie et Louis Pasteur, CRESE UR3190, F-25000 Besançon, France

No 2025-08, Working Papers from CRESE

Abstract: We study the design of optimal liability sharing rules when the use of an AI prediction by a human user may cause external damage. To do so, we set up a game-theoretic model in which an AI manufacturer chooses the level of accuracy with which an AI is developed (which increases the reliability of its prediction) and the price at which it is distributed. The user then decides whether to buy the AI. The AI’s prediction gives a signal about the state of the world, while the user chooses her effort to discover the payoffs in each possible state of the world. The user may be susceptible to an automation bias that leads her to overestimate the algorithm’s accuracy (overestimation bias). In the absence of an automation bias, we find that full user liability is optimal. However, when the user is prone to an overestimation bias, increasing the share of liability borne by the AI manufacturer can be beneficial for two reasons. First, it reduces the rent that the AI manufacturer can extract by exploiting the user’s overestimation bias by underinvesting or overinvesting in the AI accuracy. Second, due to the nature of the interaction between algorithm accuracy and the user effort, the user may be incentivized to increase her (too low) judgment effort.

Keywords: liability sharing; advisory algorithm; automation bias; prediction; judgment effort (search for similar items in EconPapers)
JEL-codes: K13 (search for similar items in EconPapers)
Pages: 34 pages
Date: 2025-06
New Economics Papers: this item is included in nep-ain, nep-gth, nep-law and nep-mic
References: Add references at CitEc
Citations:

Downloads: (external link)
https://crese.univ-fcomte.fr/wp-content/uploads/2025/07/WP-2025-08.pdf First version, 2025 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:crb:wpaper:2025-08

Access Statistics for this paper

More papers in Working Papers from CRESE Contact information at EDIRC.
Bibliographic data for series maintained by Laurent Kondratuk ().