The impact of growing participation in PISA on scaling outcomes: A Monte Carlo simulation study

Artur Pokropek, Marek Muszyński and Tomasz Żółtak
Additional contact information
Artur Pokropek: Polish Academy of Science
Marek Muszyński: Polish Academy of Science
Tomasz Żółtak: Polish Academy of Science

No 277, OECD Education Working Papers from OECD Publishing

Abstract: The OECD's PISA (Programme for International Student Assessment) is expanding on new educational systems from cycle to cycle. Most of the new participants differ significantly and negatively from the core participants in the level of educational proficiency. The study has investigated a potential expansion of the new participants’ proportion from 15% of low performing countries to 50% of low-performing countries in the PISA sample. A simulation study was performed that aimed to check whether an increasing share of low performing countries among PISA participants can affect: a) key country parameters (means and within-country standard deviations), b) item parameters (difficulty and discrimination), and c) sensitivity and specificity of differential item functioning procedures. The results of the study point out that the PISA procedures are fit and robust to the increasing proportion of low-performing countries resulting in highly reliable inter country score differences and estimates of country means.

Date: 2022-08-22
References: Add references at CitEc
Citations:

Downloads: (external link)
https://doi.org/10.1787/d5f7fcc4-en (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:oec:eduaab:277-en

Access Statistics for this paper

More papers in OECD Education Working Papers from OECD Publishing Contact information at EDIRC.
Bibliographic data for series maintained by ().