The Validity and Precision of the Comparative Interrupted Time-Series Design

Travis St.Clair, Kelly Hallberg and Thomas D. Cook
Additional contact information
Travis St.Clair: University of Maryland
Kelly Hallberg: University of Chicago
Thomas D. Cook: Northwestern University

Journal of Educational and Behavioral Statistics, 2016, vol. 41, issue 3, 269-299

Abstract: We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to those from a randomized controlled trial (RCT) that shares the same treatment group. The degree of correspondence between RCT and CITS estimates depends on the observed pretest time trend differences and how they are modeled. Where the trend differences are clear and can be easily modeled, no bias results; where the trend differences are more volatile and cannot be easily modeled, the degree of correspondence is more mixed, and the best results come from matching comparison units on both pretest and demographic covariates.

Keywords: within-study comparison; interrupted time series; comparative interrupted time series; randomized experiment; causal inference (search for similar items in EconPapers)
Date: 2016
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/1076998616636854 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:41:y:2016:i:3:p:269-299

DOI: 10.3102/1076998616636854

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().