Correcting for Sampling Problems in PISA and the Improvement in Portuguese Students' Performance
Luis Nunes (),
Ana Reis () and
FEUNL Working Paper Series from Universidade Nova de Lisboa, Faculdade de Economia
PISA uses a complex sampling procedure based on stratification variables chosen by the participating countries’ authorities. In this paper we analyse the representativeness of the samples used in terms of the distribution of students per grade and track of studies for Portugal. For the three exam years under analysis (2006, 2009 and 2012) a meaningful bias between the effective student distribution and PISA samples was found. We provide recalculated PISA scores that correct for the sample bias. We find that from 2009 to 2012, contrary to the stagnation denoted in the PISA results, the recalculated scores show an improvement in the Portuguese student performance. We also decompose the evolution of the scores into two effects: (i) change in the student population distribution by grade and track, and type of school; and (ii) evolution in the performance of each type of student. The results show that for the whole period the evolution of the students’ scores is the main driver of the increase in PISA results, with the change in the population structure playing a weaker role. Although we focus on the Portuguese case, similar problems of representativeness are expected to arise in other countries with high retention rates, affecting the grade of study of 15-year-olds. JEL codes: I20, I25
Keywords: PISA; sampling; educational achievement; age-based assessment (search for similar items in EconPapers)
New Economics Papers: this item is included in nep-edu
References: Add references at CitEc
Citations: Track citations by RSS feed
Downloads: (external link)
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
Persistent link: https://EconPapers.repec.org/RePEc:unl:unlfep:wp591
Access Statistics for this paper
More papers in FEUNL Working Paper Series from Universidade Nova de Lisboa, Faculdade de Economia Contact information at EDIRC.
Bibliographic data for series maintained by Susana Lopes ().