Rotten apples or just apples and pears? Understanding patterns consistent with cheating in international test data

Martin Gustafsson (mgustafsson@sun.ac.za) and Carol Nuga Deliwe (nuga.c@dbe.gov.za)
Additional contact information
Martin Gustafsson: ReSEP, Stellenbosch University, and Department of Basic Education
Carol Nuga Deliwe: Department of Basic Education

No 17/2017, Working Papers from Stellenbosch University, Department of Economics

Abstract: The Southern and Eastern Africa Consortium for Monitoring Educational Quality (SACMEQ) programme has succeeded in generating valuable knowledge about the outcomes of schooling in the region, and in developing capacity to use data, including test data, in governments and amongst researchers. However, there is room for improvements in the programme. The current paper examines the extent to which patterns in the 2000 and 2007 test data suggest cheating occurred. The risk of cheating during the administration of the SACMEQ tests clearly exists, both because in-built controls can be subverted and because all pupils write exactly the same test, which is unlike the situation in a programme such as TIMSS, which employs a matrix sampling test design approach. Data analysis methods developed by Jacob and Levitt (2003) to detect cheating are adapted and then applied to the SACMEQ, but also TIMSS, data. It is concluded that whilst cheating does not substantially change the overall picture of performance derived from the 2000 and 2007 data, or country rankings, noteworthy patterns highly consistent with cheating can be found in some countries, and some regions within countries. Country-level indicators of cheating in SACMEQ correlate remarkably well with World Bank indicators of general corruption. An analysis of conditional correlations within the SACMEQ data reveals that schools serving more socio-economically disadvantaged pupils are more likely to cheat. In one country, having a male school principal is associated with a higher likelihood of cheating.

Keywords: SACMEQ; TIMSS; assessment data; cheating; corruption; gender (search for similar items in EconPapers)
JEL-codes: C89 D73 I21 (search for similar items in EconPapers)
Date: 2017
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://www.ekon.sun.ac.za/wpapers/2017/wp172017/wp172017.pdf First version, 2017 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sza:wpaper:wpapers293

Access Statistics for this paper

More papers in Working Papers from Stellenbosch University, Department of Economics Contact information at EDIRC.
Bibliographic data for series maintained by Melt van Schoor (mpvs@sun.ac.za).