The Late Pretest Problem in Randomized Control Trials of Education Interventions

Peter Z. Schochet

Mathematica Policy Research Reports from Mathematica Policy Research

Abstract: Pretest and post-test experimental designs are often used in randomized control trials (RCTs) in the education field to improve the precision of the estimated treatment effects. For logistic reasons, however, pretest data are often collected after random assignment, so that including them in the analysis could bias the post-test impact estimates. Deciding whether to collect and use late pretest data in RCTs involves a variance-bias tradeoff. This paper addresses this issue both theoretically and empirically for several commonly used impact estimators, using a loss function approach grounded in the causal inference literature. For RCTs of interventions to improve student test scores, estimators that include late pretests will typically be preferred to estimators that exclude them or that instead include uncontaminated baseline test score data from other sources. This result holds as long as test score impacts do not grow very quickly early in the school year.

Keywords: Randomized; Control; Trials; Education; Interventions; Random; Assignment (search for similar items in EconPapers)
JEL-codes: I (search for similar items in EconPapers)
Date: 2008-10-30
References: View references in EconPapers View complete reference list from CitEc
Citations Track citations by RSS feed

Downloads: (external link)
https://www.mathematica-mpr.com/-/media/publicatio ... domcontroltrials.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: http://EconPapers.repec.org/RePEc:mpr:mprres:fb514df5dbb84a5dbea79865ca80d9bc

Access Statistics for this paper

More papers in Mathematica Policy Research Reports from Mathematica Policy Research Mathematica Policy Research P.O. Box 2393 Princeton, NJ 08543-2393 Attn: Communications. Contact information at EDIRC.
Series data maintained by Joanne Pfleiderer ().