Algorithm-Augmented Work and Domain Experience: The Countervailing Forces of Ability and Aversion

Ryan Allen () and Prithwiraj (Raj) Choudhury ()
Additional contact information
Ryan Allen: Harvard Business School, Boston, Massachusetts 02163
Prithwiraj (Raj) Choudhury: Harvard Business School, Boston, Massachusetts 02163

Organization Science, 2022, vol. 33, issue 1, 149-169

Abstract: Past research offers mixed perspectives on whether domain experience helps or hurts algorithm-augmented worker performance. Reconciling these perspectives, we theorize that intermediate levels of domain experience are optimal for algorithm-augmented performance, due to the interplay between two countervailing forces—ability and aversion. Although domain experience can increase performance via increased ability to complement algorithmic advice (e.g., identifying inaccurate predictions), it can also decrease performance via increased aversion to accurate algorithmic advice. Because ability developed through learning by doing increases at a decreasing rate, and algorithmic aversion is more prevalent among experts, we theorize that algorithm-augmented performance will first rise with increasing domain experience, then fall. We test this by exploiting a within-subjects experiment in which corporate information technology support workers were assigned to resolve problems both manually and using an algorithmic tool. We confirm that the difference between performance with the algorithmic tool versus without the tool was characterized by an inverted U-shape over the range of domain experience. Only workers with moderate domain experience did significantly better using the algorithm than resolving tickets manually. These findings highlight that, even if greater domain experience increases workers’ ability to complement algorithms, domain experience can also trigger other mechanisms that overcome the positive ability effect and inhibit performance. Additional analyses and participant interviews suggest that, even though the highest experience workers had the greatest ability to complement the algorithmic tool, they rejected its advice because they felt greater accountability for possible unintended consequences of accepting algorithmic advice.

Keywords: automation; domain experience; algorithmic aversion; experts; algorithms; machine learning; decision making; future of work (search for similar items in EconPapers)
Date: 2022
References: Add references at CitEc
Citations:

Downloads: (external link)
http://dx.doi.org/10.1287/orsc.2021.1554 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:inm:ororsc:v:33:y:2022:i:1:p:149-169

Access Statistics for this article

More articles in Organization Science from INFORMS Contact information at EDIRC.
Bibliographic data for series maintained by Chris Asher ().