Offline Multi-Action Policy Learning: Generalization and Optimization

Zhengyuan Zhou, Susan Athey and Stefan Wager
Additional contact information
Zhengyuan Zhou: Department of Electrical Engineering, Stanford University
Stefan Wager: Graduate School of Business, Stanford University

Research Papers from Stanford University, Graduate School of Business

Abstract: In many settings, a decision-maker wishes to learn a rule, or policy, that maps from observable characteristics of an individual to an action. Examples include selecting offers, prices, advertisements, or emails to send to consumers, as well as the problem of determining which medication to prescribe to a patient. While there is a growing body of literature devoted to this problem, most existing results are focused on the case where data comes from a randomized experiment, and further, there are only two possible actions, such as giving a drug to a patient or not. In this paper, we study the offline multi-action policy learning problem with observational data and where the policy may need to respect budget constraints or belong to a restricted policy class such as decision trees. We build on the theory of efficient semi-parametric inference in order to propose and implement a policy learning algorithm that achieves asymptotically minimax-optimal regret. To the best of our knowledge, this is the first result of this type in the multi-action setup, and it provides a substantial performance improvement over the existing learning algorithms. We then consider additional computational challenges that arise in implementing our method for the case where the policy is restricted to take the form of a decision tree. We propose two different approaches, one using a mixed integer program formulation and the other using a tree-search based algorithm.

Date: 2018-10
New Economics Papers: this item is included in nep-cmp
References: Add references at CitEc
Citations: View citations in EconPapers (35)

Downloads: (external link)
https://www.gsb.stanford.edu/gsb-cmis/gsb-cmis-download-auth/470311
Our link check indicates that this URL is bad, the error code is: 404 Not Found

Related works:
Journal Article: Offline Multi-Action Policy Learning: Generalization and Optimization (2023)
Working Paper: Offline Multi-Action Policy Learning: Generalization and Optimization (2018)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ecl:stabus:3734

Access Statistics for this paper

More papers in Research Papers from Stanford University, Graduate School of Business Contact information at EDIRC.
Bibliographic data for series maintained by ().