The Promise and Pitfalls of Differences-in-Differences: Reflections on ‘16 and Pregnant’ and Other Applications

Ariella Kahn-Lang and Kevin Lang

No 24857, NBER Working Papers from National Bureau of Economic Research, Inc

Abstract: We use the exchange between Kearney/Levine and Jaeger/Joyce/Kaestner on “16 and Pregnant” to reexamine the use of DiD as a response to the failure of nature to properly design an experiment for us. We argue that 1) any DiD paper should address why the original levels of the experimental and control groups differed, and why this would not impact trends, 2) the parallel trends argument requires a justification of the chosen functional form and that the use of the interaction coefficients in probit and logit may be justified in some cases, and 3) parallel trends in the period prior to treatment is suggestive of counterfactual parallel trends, but parallel pre-trends is neither necessary nor sufficient for the parallel counterfactual trends condition to hold. Importantly, the purely statistical approach uses pretesting and thus generates the wrong standard errors. Moreover, we underline the dangers of implicitly or explicitly accepting the null hypothesis when failing to reject the absence of a differential pre-trend.

JEL-codes: C18 C21 J13 (search for similar items in EconPapers)
Date: 2018-07
New Economics Papers: this item is included in nep-exp
Note: CH LS
References: Add references at CitEc
Citations: View citations in EconPapers (49)

Published as Ariella Kahn-Lang & Kevin Lang, 2020. "The Promise and Pitfalls of Differences-in-Differences: Reflections on and Other Applications," Journal of Business & Economic Statistics, vol 38(3), pages 613-620.

Downloads: (external link)
http://www.nber.org/papers/w24857.pdf (application/pdf)

Related works:
Journal Article: The Promise and Pitfalls of Differences-in-Differences: Reflections on 16 and Pregnant and Other Applications (2020)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:nbr:nberwo:24857

Ordering information: This working paper can be ordered from
http://www.nber.org/papers/w24857

Access Statistics for this paper

More papers in NBER Working Papers from National Bureau of Economic Research, Inc National Bureau of Economic Research, 1050 Massachusetts Avenue Cambridge, MA 02138, U.S.A.. Contact information at EDIRC.
Bibliographic data for series maintained by ().