Multiple testing and the distributional effects of accountability incentives in education

Steven Lehrer (), R. Vincent Pohl and Kyungchul Song

No 799, Ruhr Economic Papers from RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen

Abstract: Economic theory that underlies many empirical microeconomic applications predicts that treatment responses depend on individuals' characteristics and location on the outcome distribution. Using data from a large-scale Pakistani school report card experiment, we consider tests for treatment effect heterogeneity that make corrections for multiple testing to avoid an overestimation of positive treatment effects. These tests uncover evidence of policy-relevant heterogeneous effects from information provision on child test scores. Further, our analysis reinforces the importance of preventing the inflation of false positive conclusions since over 65% of statistically significant quantile treatment effects become insignificant once corrections for multiple testing are applied.

Keywords: information; student performance; accountability; quantile treatment effects; multiple testing; bootstrap tests (search for similar items in EconPapers)
JEL-codes: C12 C21 I21 L15 (search for similar items in EconPapers)
Date: 2019
New Economics Papers: this item is included in nep-exp
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.econstor.eu/bitstream/10419/195374/1/1663446083.pdf (application/pdf)

Related works:
Journal Article: Multiple Testing and the Distributional Effects of Accountability Incentives in Education (2022)
Working Paper: Multiple Testing and the Distributional Effects of Accountability Incentives in Education (2018)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:rwirep:799

DOI: 10.4419/86788927

Access Statistics for this paper

More papers in Ruhr Economic Papers from RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen Contact information at EDIRC.
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().