Uncovering Individualised Treatment Effect: Evidence from Educational Trials

ZhiMin Xiao, Oliver Hauser, Charlie Kirkwood, Daniel Li (), Benjamin Jones and Steve Higgins
Additional contact information
ZhiMin Xiao: University of Exeter
Charlie Kirkwood: University of Exeter

No 8nsw4, OSF Preprints from Center for Open Science

Abstract: The use of large-scale Randomised Controlled Trials (RCTs) is fast becoming "the gold standard" of testing the causal effects of policy, social, and educational interventions. RCTs are typically evaluated — and ultimately judged — by the economic, educational, and statistical significance of the Average Treatment Effect (ATE) in the study sample. However, many interventions have heterogeneous treatment effects across different individuals, not captured by the ATE. One way to identify heterogeneous treatment effects is to conduct subgroup analyses, such as focusing on low-income Free School Meal pupils as required for projects funded by the Education Endowment Foundation (EEF) in England. These subgroup analyses, as we demonstrate in 48 EEF-funded RCTs involving over 200,000 students, are usually not standardised across studies and offer flexible degrees of freedom to researchers, potentially leading to mixed results. Here, we develop and deploy a machine-learning and regression-based framework for systematic estimation of Individualised Treatment Effect (ITE), which can show where a seemingly ineffective and uninformative intervention worked, for whom, and by how much. Our findings have implications for decision-makers in education, public health, and medical trials.

Date: 2020-01-21
New Economics Papers: this item is included in nep-eur and nep-exp
References: Add references at CitEc
Citations:

Downloads: (external link)
https://osf.io/download/5e276f30edceab024282db78/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:osfxxx:8nsw4

DOI: 10.31219/osf.io/8nsw4

Access Statistics for this paper

More papers in OSF Preprints from Center for Open Science
Bibliographic data for series maintained by OSF ().