On the Use of Outcome Tests for Detecting Bias in Decision Making

Ivan Canay, Magne Mogstad and Jack Mountjoy

No 27802, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: The decisions of judges, lenders, journal editors, and other gatekeepers often lead to significant disparities across affected groups. An important question is whether, and to what extent, these group-level disparities are driven by relevant differences in underlying individual characteristics, or by biased decision makers. Becker (1957, 1993) proposed an outcome test of bias based on differences in post-decision outcomes across groups, inspiring a large and growing empirical literature. The goal of our paper is to offer a methodological blueprint for empirical work that seeks to use outcome tests to detect bias. We show that models of decision making underpinning outcome tests can be usefully recast as Roy models, since heterogeneous potential outcomes enter directly into the decision maker's choice equation. Different members of the Roy model family, however, are distinguished by the tightness of the link between potential outcomes and decisions. We show that these distinctions have important implications for defining bias, deriving logically valid outcome tests of such bias, and identifying the marginal outcomes that the test requires.

JEL-codes: C21 C26 C51 J15 J16 J71 K14 K42 (search for similar items in EconPapers)
Date: 2020-09
New Economics Papers: this item is included in nep-law
Note: LE LS PE TWP
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (7)

Published as Ivan A Canay & Magne Mogstad & Jack Mountjoy, 2024. "On the Use of Outcome Tests for Detecting Bias in Decision Making," Review of Economic Studies, vol 91(4), pages 2135-2167.

Downloads: (external link)
http://www.nber.org/papers/w27802.pdf (application/pdf)

Related works:
Journal Article: On the Use of Outcome Tests for Detecting Bias in Decision Making (2024)
Working Paper: On the Use of Outcome Tests for Detecting Bias in Decision Making (2020)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:27802

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w27802

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().