Improving Administrative Data at Scale: Experimental Evidence on Digital Testing in Indian Schools

Abhijeet Singh

The Economic Journal, 2024, vol. 134, issue 661, 2207-2223

Abstract: Large-scale student assessments are a cornerstone of proposed educational reforms to improve student achievement from very low levels in low- and middle-income countries. Yet, this promise relies on their presumed reliability. I use direct audit evidence from a large Indian state (Andhra Pradesh) to show that, as currently administered, official learning assessments substantially overstate proficiency and understate the ‘learning crisis’ of low student achievement. In an experiment covering over 2,400 schools, I evaluate whether digital tablet-based testing could reduce distortion. Although paper-based assessments proctored by teachers severely exaggerate achievement, tablet-based assessments closely match independent test data and are much less likely to be flagged for cheating. Furthermore, I use the direct audit-based retest to directly validate existing (indirect) statistical procedures for detecting cheating at scale and establish that it would be feasible to monitor data integrity cheaply and at scale with such methods. Overall, these results suggest that well-designed technology-aided interventions may improve data integrity at scale, without which these learning assessments are unlikely to serve as a catalyst for policy action.

Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://hdl.handle.net/10.1093/ej/ueae017 (application/pdf)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oup:econjl:v:134:y:2024:i:661:p:2207-2223.

Ordering information: This journal article can be ordered from
https://academic.oup.com/journals

Access Statistics for this article

The Economic Journal is currently edited by Francesco Lippi

More articles in The Economic Journal from Royal Economic Society Contact information at EDIRC.
Bibliographic data for series maintained by Oxford University Press () and ().