Algorithmic advice as a credence good

Jan Biermann, John J. Horton and Johannes Walter

No 22-071, ZEW Discussion Papers from ZEW - Leibniz Centre for European Economic Research

Abstract: Actors in various settings have been increasingly relying on algorithmic tools to support their decision-making. Much of the public debate concerning algorithms - especially the associated regulation of new technologies - rests on the assumption that humans can assess the quality of algorithms. We test this assumption by conducting an online experiment with 1263 participants. Subjects perform an estimation task and are supported by algorithmic advice. Our first finding is that, in our setting, humans cannot verify the algorithm's quality. We, therefore, argue that algorithms exhibit traits of a credence good - decision-makers cannot verify the quality of such goods, even after "consuming" them. Based on this finding, we test two interventions to improve the individual's ability to make good decisions in algorithmically supported situations. In the first intervention, we explain the way the algorithm functions. We find that while explanation helps participants recognize bias in the algorithm, it remarkably decreases human decision-making performance. In the second treatment, we reveal the task's correct answer after every round and find that this intervention improves human decision-making performance. Our findings have implications for policy initiatives and managerial practice.

Keywords: Human-algorithm decision making; algorithmic advice; credence goods (search for similar items in EconPapers)
JEL-codes: C91 D79 D80 M21 O30 (search for similar items in EconPapers)
Date: 2022
New Economics Papers: this item is included in nep-exp
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://www.econstor.eu/bitstream/10419/268427/1/1832664716.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:zewdip:22071

Access Statistics for this paper

More papers in ZEW Discussion Papers from ZEW - Leibniz Centre for European Economic Research Contact information at EDIRC.
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().