Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects

Michael Anderson

Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series from Department of Agricultural & Resource Economics, UC Berkeley

Abstract: The view that the returns to educational investments are highest for early childhood interventions is widely held and stems primarily from several influential randomized trials-Abecedarian, Perry, and the Early Training Project-that point to super-normal returns to early interventions. This article presents a de novo analysis of these experiments, focusing on two core issues that have received limited attention in previous analyses: treatment effect heterogeneity by gender and overrejection of the null hypothesis due to multiple inference. To address the latter issue, a statistical framework that combines summary index tests with familywise error rate and false discovery rate corrections is implemented. The first technique reduces the number of tests conducted; the latter two techniques adjust the p values for multiple inference. The primary finding of the reanalysis is that girls garnered substantial short- and long-term benefits from the interventions, but there were no significant long-term benefits for boys. These conclusions, which have appeared ambiguous when using "naive" estimatorsthat fail to adjust for multiple testing, contribute to a growing literature on the emerging female-male academic achievement gap. They also demonstrate that in complex studies where multiple questions are asked of the same data set, it can be important to declare the family of tests under consideration and to either consolidate measures or report adjusted and unadjusted p values. © 2008 American Statistical Association.

Keywords: Pediatric; False discovery rate; Familywise error rate; Multiple comparisons; Preschool; Program evaluation; Statistics; Econometrics; Demography; Statistics & Probability (search for similar items in EconPapers)
Date: 2008-12-01
References: Add references at CitEc
Citations: View citations in EconPapers (1154)

Downloads: (external link)
https://www.escholarship.org/uc/item/15n8j26f.pdf;origin=repeccitec (application/pdf)

Related works:
Journal Article: Multiple Inference and Gender Differences in the Effects of Early Intervention: A Reevaluation of the Abecedarian, Perry Preschool, and Early Training Projects (2008)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:cdl:agrebk:qt15n8j26f

Access Statistics for this paper

More papers in Department of Agricultural & Resource Economics, UC Berkeley, Working Paper Series from Department of Agricultural & Resource Economics, UC Berkeley Contact information at EDIRC.
Bibliographic data for series maintained by Lisa Schiff ().