PISA 2012: How do results for the paper and computer tests compare?

John Jerrim ()
Additional contact information
John Jerrim: Institute of Education, University College London

No 16-02, DoQSS Working Papers from Quantitative Social Science - UCL Social Research Institute, University College London

Abstract: The Programme for International Assessment (PISA) is an important cross-national study of 15 year olds academic achievement. Although it has traditionally been conducted using paper-and-pencil tests, the vast majority of countries will use computer-based assessment from 2015. In this paper we consider how cross-country comparisons of children's skills differ between paper and computer versions of the PISA mathematics test. Using data from PISA 2012, where more than 200,000 children from 32 economies completed both paper and computer versions of the mathematics assessment, we find important and interesting differences between the two sets of results. This includes a substantial drop of more than 50 PISA test points (half a standard deviation) in the average performance of children from Shanghai-China. Moreover, by considering children's responses to particular test items, we show how differences are unlikely to be solely due to the interactive nature of certain computer test questions. The paper concludes with a discussion of what the findings imply for interpretation of PISA results in 2015 and beyond.

Keywords: PISA; computer-based assessment; Shanghai-China; educational inequality (search for similar items in EconPapers)
JEL-codes: I2 (search for similar items in EconPapers)
Date: 2016-02-15
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://repec.ucl.ac.uk/REPEc/pdf/qsswp1602.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:qss:dqsswp:1602

Access Statistics for this paper

More papers in DoQSS Working Papers from Quantitative Social Science - UCL Social Research Institute, University College London Quantitative Social Science, Social Research Institute, 55-59 Gordon Square, London WC1H 0NU. Contact information at EDIRC.
Bibliographic data for series maintained by Dr Neus Bover Fonts ().