The barking dog that bites: Test score volatility and school rankings in Punjab, Pakistan
Felipe Barrera-Osorio and
Alejandro Ganimian ()
International Journal of Educational Development, 2016, vol. 49, issue C, 31-54
Abstract:
This paper is the first to explore the implications of test score volatility for school accountability policies in a lower-middle-income country. Using two new datasets from the province of Punjab, Pakistan, we find that rankings based on school-level averages of students’ test scores fluctuate considerably from one year to the next due to factors unrelated to school quality. First, most variation in test scores is within, not between schools, allowing noise to play a large part in determining school rankings. Second, variation in school test scores is partially attributable to fluctuations in the characteristics of student cohorts. Third, an even larger share is explained by one-time shocks. Fourth, these problems are more pronounced in small schools. As a result, rankings that rely on test score levels or changes often fail to identify top-performing or rapidly-improving schools, since they are influenced by factors beyond schools’ control.
Keywords: School rankings; Accountability; Test score volatility (search for similar items in EconPapers)
Date: 2016
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (4)
Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/S0738059316300049
Full text for ScienceDirect subscribers only
Related works:
Working Paper: The barking dog that bites: Test score volatility and school rankings in Punjab, Pakistan (2013) 
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:eee:injoed:v:49:y:2016:i:c:p:31-54
DOI: 10.1016/j.ijedudev.2016.01.004
Access Statistics for this article
International Journal of Educational Development is currently edited by Stephen P Heyneman
More articles in International Journal of Educational Development from Elsevier
Bibliographic data for series maintained by Catherine Liu ().