Diagnosing Physician Error: A Machine Learning Approach to Low-Value Health Care

Sendhil Mullainathan and Ziad Obermeyer

No 26168, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: We use machine learning as a tool to study decision making, focusing specifically on how physicians diagnose heart attack. An algorithmic model of a patient’s probability of heart attack allows us to identify cases where physician testing decisions deviate from predicted risk. We then use actual health outcomes to evaluate whether those deviations represent mistakes or physicians’ superior knowledge. This approach reveals two inefficiencies. Physicians over-test: predictably low-risk patients are tested, but do not benefit. At the same time, physicians undertest: predictably high-risk patients are left untested, and then go on to suffer adverse health events including death. A natural experiment using shift-to-shift testing variation confirms these findings. Simultaneous over- and under-testing cannot easily be explained by incentives alone, and instead point to systematic errors in judgment. We provide suggestive evidence on the psychology underlying these errors. First, physicians use too simple a model of risk. Second, they overweight factors that are salient or representative of heart attack, such as chest pain. We argue health care models must incorporate physician error, and illustrate how policies focused solely on incentive problems can produce large inefficiencies.

JEL-codes: C55 D8 D84 D9 I1 I13 (search for similar items in EconPapers)
Date: 2019-08
New Economics Papers: this item is included in nep-big and nep-hea
Note: AG EH LS PR
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (8)

Published as Sendhil Mullainathan & Ziad Obermeyer, 2022. "Diagnosing Physician Error: A Machine Learning Approach to Low-Value Health Care," The Quarterly Journal of Economics, vol 137(2), pages 679-727.

Downloads: (external link)
http://www.nber.org/papers/w26168.pdf (application/pdf)

Related works:
Journal Article: Diagnosing Physician Error: A Machine Learning Approach to Low-Value Health Care (2023)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:26168

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w26168

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().