Leveraging Experimental and Observational Evidence to Assess the Generalizability of the Effects of Early Colleges in North Carolina

Sarah Fuller (), Douglas Lee Lauen () and Fatih Unlu ()
Additional contact information
Sarah Fuller: The University of North Carolina Department of Public Policy Education Policy Initiative at Carolina Chapel Hill, NC 27599
Douglas Lee Lauen: The University of North Carolina Department of Public Policy Education Policy Initiative at Carolina Chapel Hill, NC 27599
Fatih Unlu: Rand Corporation Santa Monica, CA 90401

Education Finance and Policy, 2023, vol. 18, issue 4, 568-596

Abstract: Early college high schools (ECHSs) in North Carolina are small public schools of choice on college campuses that seek to promote attaining postsecondary credits in high school, college readiness, and postsecondary enrollment for underrepresented groups. Evidence from randomized control trials (RCTs) has shown positive effects of the ECHS model on important high school and postsecondary outcomes but appear to be underpowered to detect moderation effects. Furthermore, RCTs rarely address the key question of primary policy interest: Is the program effective on average across the population? This leaves us uncertain about (1) whether the early college intervention is a good strategy for helping to close enrollment and attainment gaps between under- and overrepresented groups, and (2) whether the expansion of the ECHS model will lead to the positive results that the RCT studies suggest. This study uses administrative data on all ECHSs in North Carolina including those that were part of a lottery study. This allows us to generate RCT estimates for the ECHSs in the lottery sample and quasi-experimental estimates for both the lottery and non-lottery ECHSs. We leverage this unique circumstance to generate estimates of the effect of ECHS on postsecondary outcomes that simultaneously maximize both internal and external validity. Specifically, because generalization depends on both moderation and sample selection, we (1) investigate sample selection, (2) conduct a moderation analysis to determine whether the effects of the intervention vary by key factors that also predict sample selection, and (3) produce a pooled estimate by extending a method called cross-design synthesis to incorporate both RCT evidence and quasi-experimental evidence. We find strong evidence that the positive results of the RCTs generalize to the full sample of ECHSs, which provides stronger evidence of effectiveness.

Date: 2023
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1162/edfp_a_00379
Access to PDF is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:tpr:edfpol:v:18:y:2023:i:4:p:568-596

Ordering information: This journal article can be ordered from
https://mitpressjour ... rnal/?issn=1557-3060

Access Statistics for this article

Education Finance and Policy is currently edited by Stephanie Riegg Cellini and Randall Reback

More articles in Education Finance and Policy from MIT Press
Bibliographic data for series maintained by The MIT Press ().