Comparing Inference Approaches for RD Designs: A Reexamination of the Effect of Head Start on Child Mortality

Burt S. Barnow, Matias Cattaneo, Rocio Titiunik and Gonzalo Vazquez‐Bare

Journal of Policy Analysis and Management, 2017, vol. 36, issue 3, 643-681

Abstract: The regression discontinuity (RD) design is a popular quasi‐experimental design for causal inference and policy evaluation. The most common inference approaches in RD designs employ “flexible” parametric and nonparametric local polynomial methods, which rely on extrapolation and large‐sample approximations of conditional expectations using observations somewhat near the cutoff that determines treatment assignment. An alternative inference approach employs the idea of local randomization, where the very few units closest to the cutoff are regarded as randomly assigned to treatment and finite‐sample exact inference methods are used. In this paper, we contrast these approaches empirically by re‐analyzing the influential findings of Ludwig and Miller ( ), who studied the effect of Head Start assistance on child mortality employing parametric RD methods. We first review methods based on approximations of conditional expectations, which are relatively well developed in the literature, and then present new methods based on randomization inference. In particular, we extend the local randomization framework to allow for parametric adjustments of the potential outcomes; our extended framework substantially relaxes strong assumptions in prior literature and better resembles other RD inference methods. We compare all these methods formally, focusing on both estimands and inference properties. In addition, we develop new approaches for randomization‐based sensitivity analysis specifically tailored to RD designs. Applying all these methods to the Head Start data, we find that the original RD treatment effect reported in the literature is quite stable and robust, an empirical finding that enhances the credibility of the original result. All the empirical methods we discuss are readily available in general purpose software in R and Stata; we also provide the dataset and software code needed to replicate all our results.

Date: 2017
References: Add references at CitEc
Citations: View citations in EconPapers (74)

Downloads: (external link)
http://hdl.handle.net/10.1002/pam.21985

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:wly:jpamgt:v:36:y:2017:i:3:p:643-681

Access Statistics for this article

More articles in Journal of Policy Analysis and Management from John Wiley & Sons, Ltd.
Bibliographic data for series maintained by Wiley Content Delivery ().