Testing for Structural Breaks in the Evaluation of Programs

Anne Piehl, Suzanne J. Cooper, Anthony A. Braga and David M. Kennedy
Additional contact information
Suzanne J. Cooper: John F. Kennedy School of Government, Harvard University
Anthony A. Braga: John F. Kennedy School of Government, Harvard University
David M. Kennedy: John F. Kennedy School of Government, Harvard University

The Review of Economics and Statistics, 2003, vol. 85, issue 3, 550-558

Abstract: A youth homicide reduction initiative in Boston in the mid-1990s poses particular difficulties for program evaluation because it did not have a control group and the exact implementation date is unknown. A standard methodology in program evaluation is to use time series variation to compare pre- and postprogram outcomes. Such an approach is not valid, however, when the timing of program implementation or effect is unknown. To evaluate the Boston initiative, we adapt from the time series literature an unknown-breakpoint test to test for a change in regime. Tests for parameter instability provide a flexible framework for testing a range of hypotheses commonly posed in program evaluation. These tests both pinpoint the timing of maximal break and provide a valid test of statistical significance. We evaluate the results of the estimation using the asymptotic results in the literature and with our own Monte Carlo analyses. We conclude there was a statistically significant discontinuity in youth homicide incidents (on the order of 60%) shortly after the intervention was unveiled. © 2003 President and Fellows of Harvard College and the Massachusetts Institute of Technology.

Date: 2003
References: Add references at CitEc
Citations: View citations in EconPapers (54)

Downloads: (external link)
http://www.mitpressjournals.org/doi/pdf/10.1162/003465303322369713 link to full text (application/pdf)
Access to full text is restricted to subscribers.

Related works:
Working Paper: Testing for Structural Breaks in the Evaluation of Programs (2001)
Working Paper: Testing for Structural Breaks in the Evaluation of Programs (1999)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:tpr:restat:v:85:y:2003:i:3:p:550-558

Ordering information: This journal article can be ordered from
https://mitpressjour ... rnal/?issn=0034-6535

Access Statistics for this article

The Review of Economics and Statistics is currently edited by Pierre Azoulay, Olivier Coibion, Will Dobbie, Raymond Fisman, Benjamin R. Handel, Brian A. Jacob, Kareen Rozen, Xiaoxia Shi, Tavneet Suri and Yi Xu

More articles in The Review of Economics and Statistics from MIT Press
Bibliographic data for series maintained by The MIT Press ().