 Assessors influence results: Evidence on enumerator effects and educational impact evaluationsDaniel Rodriguez-Segura and Beth E. Schueler Journal of Development Economics, 2023, vol. 163, issue C Abstract: A significant share of education research uses data collected by “enumerators.” It is well-documented that “enumerator effects”—or inconsistent practices among the people who administer measurement tools—can be a key source of error in survey data collection. However, it is less understood whether this is a problem for academic assessments. We leverage a remote phone-based mathematics assessment of primary school students and survey of their parents in Kenya. Enumerators, who were teachers in our partner's network, were randomized to students to study the presence of enumerator effects. We find that both the academic assessment and survey were prone to enumerator effects and use simulation to show that these effects were large enough to lead to spurious results at a troubling rate in impact evaluations. We therefore recommend assessment administrators randomize enumerators at the student level, orthogonal to categories being compared (e.g., treatment/control groups), and train enumerators to minimize bias. Keywords: Enumerator effects; Impact evaluations; Remote assessments; Education in developing countries (search for similar items in EconPapers) Downloads: (external link) Related works: Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text Persistent link: https://EconPapers.repec.org/RePEc:eee:deveco:v:163:y:2023:i:c:s0304387823000123 DOI: 10.1016/j.jdeveco.2023.103057 Access Statistics for this article Journal of Development Economics is currently edited by M. R. Rosenzweig More articles in Journal of Development Economics from Elsevier |
Is your work missing from RePEc? Here is how to contribute.
Questions or problems? Check the EconPapers FAQ or send mail to .
EconPapers is hosted by the
School of Business at Örebro University.