Using Synthetic Controls to Evaluate the Effect of Unique Interventions: The Case of Say Yes to Education

Robert Bifulco, Ross Rubenstein and Hosung Sohn

Evaluation Review, 2017, vol. 41, issue 6, 593-619

Abstract: Background: “Place-based†scholarships seek to improve student outcomes in urban school districts and promote urban revitalization in economically challenged cities. Say Yes to Education is a unique district-wide school reform effort adopted in Syracuse, NY, in 2008. It includes full-tuition scholarships for public and private universities, coupled with extensive wraparound support services in schools. Objectives: This study uses synthetic control methods to evaluate the effect of Say Yes on district enrollment and graduation rates. It also introduces the synthetic control method and provides guidance for its use in evaluating single-site interventions. Method: Combining school district-level data from the National Center for Education Statistics’ Common Core of Data and New York State School Report Cards, this article uses synthetic control methods to construct a synthetic comparison district to estimate counterfactual enrollment and graduation trends for Syracuse. Results: We find that Say Yes to Education was associated with enrollment increases in the Syracuse City School District, a district that had previously experienced decades of sustained enrollment declines. We do not find consistent evidence of changes in graduation rates following adoption of the program. Conclusions: Graduation rate analyses demonstrate that estimates of treatment effects can be sensitive to choices that the researcher has to make in applying synthetic control methods, particularly when pretreatment outcome measures appear to have considerable amounts of noise.

Keywords: Say Yes to Education; place-based policy; synthetic control method (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
https://journals.sagepub.com/doi/10.1177/0193841X17742233 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:evarev:v:41:y:2017:i:6:p:593-619

DOI: 10.1177/0193841X17742233

Access Statistics for this article

More articles in Evaluation Review
Bibliographic data for series maintained by SAGE Publications ().