Assessing the Performance of Nonexperimental Estimators for Evaluating Head Start

Andrew Griffen () and Petra Todd

Journal of Labor Economics, 2017, vol. 35, issue S1, S7 - S63

Abstract: This paper uses experimental data from the Head Start Impact Study (HSIS) combined with nonexperimental data from the Early Childhood Longitudinal Study–Birth Cohort (ECLS-B) to study the performance of nonexperimental estimators for evaluating Head Start program impacts. The estimators studied include parametric cross-section and difference-in-differences regression estimators and nonparametric cross-section and difference-in-differences matching estimators. The estimators are used to generate program impacts on cognitive achievement test scores, child health measures, parenting behaviors, and parent labor market outcomes. Some of the estimators closely reproduce the experimental results, but a priori it would be difficult to know whether the estimator works well for any particular outcome. Pre-program exogeneity tests eliminate some outcomes and estimators with the worst biases, but estimators/outcomes with substantial biases pass the tests. The difference-in-differences matching estimator exhibits the best performance in terms of low bias values and capturing the pattern of statistically significant treatment effects. However, the variation in bias is greater across outcomes examined than across methods.

Date: 2017
References: Add references at CitEc
Citations: View citations in EconPapers (6)

Downloads: (external link)
http://dx.doi.org/10.1086/691726 (application/pdf)
http://dx.doi.org/10.1086/691726 (text/html)
Access to the online full text or PDF requires a subscription.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ucp:jlabec:doi:10.1086/691726

Access Statistics for this article

More articles in Journal of Labor Economics from University of Chicago Press
Bibliographic data for series maintained by Journals Division ().