Same Difference? Understanding Variation in the Estimation of Effect Sizes from Educational Trials

ZhiMin Xiao, Adetayo Kasim and Steve Higgins
Additional contact information
ZhiMin Xiao: University of Exeter

No wkf7v, OSF Preprints from Center for Open Science

Abstract: By applying four analytic models with comparable outcomes and covariates to a dataset of 20 outcomes from 17 educational trials, we found results closely matching in well-powered studies without serious implementation problems. The interventions and evaluations were all funded by the Education Endowment Foundation and independently evaluated. We demonstrated that when an analysis takes little account of research design, or where there were difficulties with implementation and data collection, point estimates of effect differ and estimates of precision vary. This adds to the challenge of understanding the comparative impact of interventions and deciding which are worth scaling up.

Date: 2017-08-12
References: Add references at CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://osf.io/download/598f50b2b83f690251e298cf/

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:osf:osfxxx:wkf7v

DOI: 10.31219/osf.io/wkf7v

Access Statistics for this paper

More papers in OSF Preprints from Center for Open Science
Bibliographic data for series maintained by OSF ().