Algorithm is Experiment: Machine Learning, Market Design, and Policy Eligibility Rules

Yusuke Narita () and Kohei Yata

Discussion papers from Research Institute of Economy, Trade and Industry (RIETI)

Abstract: Algorithms produce a growing portion of decisions and recommendations both in policy and business. Such algorithmic decisions are natural experiments (conditionally quasi-randomly assigned instruments) since the algorithms make decisions based only on observable input variables. We use this observation to develop a treatment-effect estimator for a class of stochastic and deterministic algorithms. Our estimator is shown to be consistent and asymptotically normal for well-defined causal effects. A key special case of our estimator is a high-dimensional regression discontinuity design. The proofs use tools from differential geometry and geometric measure theory, which may be of independent interest. The practical performance of our method is first demonstrated in a high-dimensional simulation resembling decision-making by machine learning algorithms. Our estimator has smaller mean squared errors compared to alternative estimators. We finally apply our estimator to evaluate the effect of the Coronavirus Aid, Relief, and Economic Security (CARES) Act, where more than $10 billion worth of relief funding is allocated to hospitals via an algorithmic rule. The estimates suggest that the relief funding has little effect on COVID-19-related hospital activity levels. Naive OLS and IV estimates exhibit substantial selection bias.

Pages: 99 pages
Date: 2021-07
New Economics Papers: this item is included in nep-big and nep-cmp
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (2)

Downloads: (external link)
https://www.rieti.go.jp/jp/publications/dp/21e057.pdf (application/pdf)

Related works:
Working Paper: Algorithm as Experiment: Machine Learning, Market Design, and Policy Eligibility Rules (2023)
Working Paper: Algorithm is Experiment: Machine Learning, Market Design, and Policy Eligibility Rules (2021)
Working Paper: Algorithm is Experiment: Machine Learning, Market Design, and Policy Eligibility Rules (2021)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eti:dpaper:21057

Access Statistics for this paper

More papers in Discussion papers from Research Institute of Economy, Trade and Industry (RIETI) Contact information at EDIRC.
Bibliographic data for series maintained by TANIMOTO, Toko ().