Robust Inferences from a Before-and-After Study with Multiple Unaffected Control Groups

Wang Pengyuan (), Traskin Mikhail () and Small Dylan S. ()
Additional contact information
Wang Pengyuan: Yahoo! Lab, 701 1st Ave, Sunnyvale, CA 94085, USA
Traskin Mikhail: Amazon.com, 207 Boren Ave. N., Seattle, WA 98109
Small Dylan S.: Department of Statistics, University of Pennsylvania, 3730 Walnut Street 400 Jon M. Huntsman Hall, Philadelphia, PA 19104, USA

Journal of Causal Inference, 2013, vol. 1, issue 2, 209-234

Abstract: The before-and-after study with multiple unaffected control groups is widely applied to study treatment effects. The current methods usually assume that the control groups’ differences between the before and after periods, i.e. the group time effects, follow a normal distribution. However, there is usually no strong a priori evidence for the normality assumption, and there are not enough control groups to check the assumption. We propose to use a flexible skew-t distribution family to model group time effects, and consider a range of plausible skew-t distributions. Based on the skew-t distribution assumption, we propose a robust-t method to guarantee nominal significance level under a wide range of skew-t distributions, and hence make the inference robust to misspecification of the distribution of group time effects. We also propose a two-stage approach, which has lower power compared to the robust-t method, but provides an opportunity to conduct sensitivity analysis. Hence, the overall method of analysis is to use the robust-t method to test for the overall hypothesized range of shapes of group variation; if the test fails to reject, use the two-stage method to conduct a sensitivity analysis to see if there is a subset of group variation parameters for which we can be confident that there is a treatment effect. We apply the proposed methods to two datasets. One dataset is from the Current Population Survey (CPS) to study the impact of the Mariel Boatlift on Miami unemployment rates between 1979 and 1982.The other dataset contains the student enrollment and grade repeating data in West Germany in the 1960s with which we study the impact of the short school year in 1966–1967 on grade repeating rates.

Keywords: before-and-after study; difference-in-difference; robust inference; skew-t distribution; group time effect (search for similar items in EconPapers)
Date: 2013
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://doi.org/10.1515/jci-2012-0010 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bpj:causin:v:1:y:2013:i:2:p:209-234:n:3

DOI: 10.1515/jci-2012-0010

Access Statistics for this article

Journal of Causal Inference is currently edited by Elias Bareinboim, Jin Tian and Iván Díaz

More articles in Journal of Causal Inference from De Gruyter
Bibliographic data for series maintained by Peter Golla ().