INVESTIGATING THE CROSS-NATIONAL COMPARABILITY OF TESTING USING RESPONSE TIMES

Denis Federiakin ()
Additional contact information
Denis Federiakin: National Research University Higher School of Economics

HSE Working papers from National Research University Higher School of Economics

Abstract: The cross-national comparability of testing results is one of the main concerns associated with international assessment. One way to approach this concern is the theoretical framework of cross-national comparability. One such framework, proposed by Van de Vijver and Tanzer [1997], describes the bias in item meaning across countries and the bias in terms of test administration procedures and respondent behavior across countries. To study how items function in terms of respondent behavior and in terms of their psychological meaning, we introduce the concept of time-related differential item functioning (DIF). This concept is similar to traditional DIF but describes the incomparable time parameters of items across countries rather than item difficulty parameters. We discuss time-related DIF, referencing dual processing cognitive theory and illustrate how it limits the interpretability of a certain type of time-related DIF. We also demonstrate the analysis with real data, and discuss the difference introduced by response time information in parameter interpretation and modelling results.

Keywords: Cross-national comparability; method bias; item response time; Rasch model; differential item functioning (search for similar items in EconPapers)
JEL-codes: Z0 (search for similar items in EconPapers)
Pages: 23 pages
Date: 2020
References: View references in EconPapers View complete reference list from CitEc
Citations:

Published in WP BRP Series: Education / EDU, February 2020, pages 1-23

Downloads: (external link)
https://wp.hse.ru/data/2020/02/28/1560424464/57EDU2020.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:hig:wpaper:57edu2020

Access Statistics for this paper

More papers in HSE Working papers from National Research University Higher School of Economics
Bibliographic data for series maintained by Shamil Abdulaev () and Shamil Abdulaev ().