Why Experimenters Might Not Always Want to Randomize, and What They Could Do Instead

Maximilian Kasy

Working Paper from Harvard University OpenScholar

Abstract: This paper discusses experimental design for the case that (i) we are given a distribution of covariates from a pre-selected random sample, and (ii) we are interested in the average treatment effect (ATE) of some binary treatment. We show that in general there is a unique optimal non-random treatment assignment if there are continuous covariates. We argue that experimenters should choose this assignment. The optimal assignment minimizes the risk (e.g., expected squared error) of treatment effects estimators. We provide explicit expressions for the risk, and discuss algorithms which minimize it. The objective of controlled trials is to have treatment groups which are similar a priori (balanced), so we can ``compare apples with apples.'' The expressions for risk derived in this paper provide an operationalization of the notion of balance. The intuition for our non-randomization result is similar to the reasons for not using randomized estimators - adding noise can never decrease risk. The formal setup we consider is decision-theoretic and nonparametric. In simulations and an application to project STAR we find that optimal designs have mean squared errors of up to 20% less than randomized designs and up to 14% less than stratified designs..

References: Add references at CitEc
Citations: View citations in EconPapers (31)

Downloads: (external link)
http://scholar.harvard.edu/kasy/node/36154

Related works:
Journal Article: Why Experimenters Might Not Always Want to Randomize, and What They Could Do Instead (2016)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:qsh:wpaper:36154

Access Statistics for this paper

More papers in Working Paper from Harvard University OpenScholar Contact information at EDIRC.
Bibliographic data for series maintained by Richard Brandon ( this e-mail address is bad, please contact ).