Economics at your fingertips  

Adaptive Treatment Assignment in Experiments for Policy Choice

Maximilian Kasy () and Anja Sautmann ()

No 7778, CESifo Working Paper Series from CESifo Group Munich

Abstract: The goal of many experiments is to inform the choice between different policies. However, standard experimental designs are geared toward point estimation and hypothesis testing. We consider the problem of treatment assignment in an experiment with several non-overlapping waves, where the goal is to choose among a set of possible policies (treatments) for large-scale implementation. The optimal experimental design learns from earlier waves and assigns more experimental units to the better-performing treatments in later waves. We propose a computationally tractable approximation of the optimal design that we call “exploration sampling,” where assignment probabilities are an increasing concave function of the posterior probabilities that each treatment is optimal. Theoretical results and calibrated simulations demonstrate improvements in welfare, relative to both non-adaptive designs as well as bandit algorithms. An application to selecting between different recruitment strategies for an agricultural extension service in Odisha, India demonstrates practical feasibility.

Keywords: experimental design; field experiments; optimal policy (search for similar items in EconPapers)
New Economics Papers: this item is included in nep-exp
Date: 2019
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1) Track citations by RSS feed

Downloads: (external link) (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link:

Access Statistics for this paper

More papers in CESifo Working Paper Series from CESifo Group Munich Contact information at EDIRC.
Bibliographic data for series maintained by Klaus Wohlrabe ().

Page updated 2019-12-08
Handle: RePEc:ces:ceswps:_7778