Reliability and separation index analysis of mathematics questions integrated with the cultural architecture framework using the Rasch model

Muh Fitrah (), Anastasia Sofroniou (), Ofianto (), Loso Judijanto () and Widihastuti ()

Journal of Education and e-Learning Research, 2024, vol. 11, issue 3, 499-519

Abstract: This research uses Rasch model analysis to identify the reliability and separation index of an integrated mathematics test instrument with a cultural architecture structure in measuring students' mathematical thinking abilities. The study involved 357 students from six eighth-grade public junior high schools in Bima. The selection of schools was based on average school exam scores and considered the effectiveness of the learning process that used cultural settings to explore mathematical content. Data analysis was conducted using Microsoft Excel to calculate the content validity of Aiken's index with four experts and the jMetrik software to measure reliability and the separation index. The research results indicate that the mathematics test instrument passed validation by mathematics experts and measurements with a valid content validity level. Rasch model calibration shows a very high level of instrument reliability. Separation analysis on the logit scale indicates the instrument's ability to differentiate students with different ability levels with good homogeneity in the distribution of test items and individual abilities. Scale quality statistics show good item response variability, low error rates and a high separation index. This study has limitations because it focuses solely on multiple-choice questions. Similar research must be conducted using other types of questions (such as those used in PISA, namely open- constructed and closed-constructed questions) and integrating other mathematical materials within relevant cultural architectural structures.

Keywords: Culture; Mathematics test instrument; Rasch model; Reliability; Separation index. (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.asianonlinejournals.com/index.php/JEELR/article/view/5861/2852 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:aoj:jeelre:v:11:y:2024:i:3:p:499-519:id:5861

Access Statistics for this article

More articles in Journal of Education and e-Learning Research from Asian Online Journal Publishing Group
Bibliographic data for series maintained by Sara Lim ().