Jointly exploring mathematics ability and speed in large-scale computer-based testing

Luca Bungaro, Marta Desimoni, Mariagiulia Matteucci and Stefania Mignani
Additional contact information
Luca Bungaro: University of Bologna
Marta Desimoni: National Institute for the Evaluation of the Education and Training Educational System (INVALSI)
Stefania Mignani: University of Bologna

Statistical Methods & Applications, 2024, vol. 33, issue 5, No 7, 1429-1450

Abstract: Abstract In large-scale tests, the implementation of computer-based testing (CBT) allows to automatically collect data not only on the students’ response accuracy (RA) based on item responses of the test, but also on their response time (RT). RTs can provide a more comprehensive view of a test-taker’s performance beyond just what is obtainable based on correct responses alone. In this paper a joint approach is considered to improve the estimation of ability scores involving complex data coming from computer-based test administration. The study focuses on analysing the data of Italian grade 10 mathematics national assessment administered by the National Institute for the Evaluation of the Education and Training System (INVALSI). In addition, a bivariate multilevel regression with speed and ability estimates, obtained by joint model, is developed including individual covariates to evaluate the contribution of individual and contextual variables in predicting test-taking speed and ability. Overall, the main results indicate that mathematics ability and speed are significantly and negatively correlated, and that the hierarchical data structure (students nested into classes) should be taken into account when explaining the dependency of ability and speed on explanatory variables, such as prior achievement, test anxiety, sociodemographic covariates, class compositional variables, school tracks and geographical area.

Keywords: Computer-based testing; Response times; Multilevel models; Standardized mathematics tests (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10260-024-00762-0 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:stmapp:v:33:y:2024:i:5:d:10.1007_s10260-024-00762-0

Ordering information: This journal article can be ordered from
http://www.springer. ... cs/journal/10260/PS2

DOI: 10.1007/s10260-024-00762-0

Access Statistics for this article

Statistical Methods & Applications is currently edited by Tommaso Proietti

More articles in Statistical Methods & Applications from Springer, Società Italiana di Statistica
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().