"Try to Balance the Baseline": A Comment on "Parent-Teacher Meetings and Student Outcomes: Evidence from a Developing Country" by Islam (2019)

Carl Bonander, Olle Hammar, Niklas Jakobsson, Gunther Bensch, Felix Holzmeister and Abel Brodeur

No 214, I4R Discussion Paper Series from The Institute for Replication (I4R)

Abstract: Islam (2019) reports results from a randomized field experiment in Bangladesh that examines the effects of parent-teacher meetings on student test scores in primary schools. The reported findings suggest strong positive effects across multiple subjects. In this report, we demonstrate that the school-level randomization cannot have been conducted as the author claims. Specifically, we show that the nine included Bangladeshi unions all have a share of either 0% or 100% treated or control schools. Additionally, we uncover irregularities in baseline scores, which for the same students and subjects vary systematically across the author's data files in ways that are unique to either the treatment or control group. We also discovered data on two unreported outcomes and data collected from the year before the study began. Results using these data cast further doubt on the validity of the original study. Moreover, in a survey asking parents to evaluate the parent-teacher meetings, we find that parents in the control schools were more positive about this intervention than those in the treated schools. We also find undisclosed connections to two additional RCTs.

Keywords: Reproduction; Student outcomes; Field experiments; Bangladesh (search for similar items in EconPapers)
JEL-codes: B41 C12 I25 (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.econstor.eu/bitstream/10419/313402/1/I4R-DP214.pdf (application/pdf)

Related works:
Working Paper: “Try to Balance the Baseline”: A Comment on “Parent-Teacher Meetings and Student Outcomes: Evidence from a Developing Country” by Islam (2019) (2025)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:i4rdps:214

Access Statistics for this paper

More papers in I4R Discussion Paper Series from The Institute for Replication (I4R)
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().