Can learning be measured by phone? Evidence from Kenya

Daniel Rodriguez-Segura and Beth E. Schueler

Economics of Education Review, 2022, vol. 90, issue C

Abstract: School closures induced by COVID-19 placed heightened emphasis on alternative ways to measure learning besides in-person exams. We leverage the administration of phone-based assessments (PBAs) measuring numeracy and literacy for primary school children in Kenya, along with in-person standardized tests administered to the same students prior to school shutdowns, to assess the validity of PBAs. Compared to repeated in-person assessments, PBAs did not severely misclassify students’ relative performance, but PBA scores did tend to be further from baseline in-person scores than repeated in-person assessments from each other. As such, PBAs performed well at measuring aggregate but not individual learning levels. Administrators can therefore use these tools for aggregate measurement, such as in the context of impact evaluation, but should be wary of PBAs for individual-level tracking or high-stakes decisions. Results also reveal the importance of making deliberate efforts to reach a representative sample and selecting items that provide discriminating power. Finally, in cases when collecting in-person data is possible, this study illustrates that, depending on the logistical capabilities of the data collecting agency, PBAs do not always have a cost-effectiveness advantage over in-person data collection.

Keywords: Phone-based assessments; Remote learning; School closures; Education in developing countries (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0272775722000826
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:ecoedu:v:90:y:2022:i:c:s0272775722000826

DOI: 10.1016/j.econedurev.2022.102309

Access Statistics for this article

Economics of Education Review is currently edited by E. Cohn

More articles in Economics of Education Review from Elsevier
Bibliographic data for series maintained by Catherine Liu ().