Validating and refining a multi-dimensional scale for measuring AI literacy in education using the Rasch Model

Ying Dong, Wei Xu (), Jiayan Huang and Kerr Yann ()
Additional contact information
Ying Dong: Hebei Normal University of Science and Technology
Wei Xu: City University of Macau
Jiayan Huang: City University of Macau
Kerr Yann: Macau Millennium College

Palgrave Communications, 2025, vol. 12, issue 1, 1-13

Abstract: Abstract AI literacy in education is a multi-dimensional concept involving the understanding of AI technologies, critical appraisal of AI technologies, practical application, and AI ethics. Through the Rasch Model, this duplication study validated and revised the scales used in previous studies to measure AI literacy in education. Based on the literature, we developed a scale to measure AI literacy in education, including technological understanding, critical appraisal, practical application, and AI ethics, whose validity and reliability were examined using the Rasch Model. Based on the results of validity, we removed items whose infit/outfit mean square (MNSQ) or standardized mean square (ZSTD) values fell outside the acceptable range (0.6–1.4 for MNSQ; −2 to 2 for ZSTD). This enhances the validity and provides reliable results, enabling the scale to measure AI literacy in education effectively. Future research can conduct an in-depth examination of the Rasch Model for the construction of AI literacy in education, validating its cross-disciplinary generalizability, exploring cultural and demographic factors, and enhancing the generalizability and precision of the scale.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1057/s41599-025-05670-6 Abstract (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:pal:palcom:v:12:y:2025:i:1:d:10.1057_s41599-025-05670-6

Ordering information: This journal article can be ordered from
https://www.nature.com/palcomms/about

DOI: 10.1057/s41599-025-05670-6

Access Statistics for this article

More articles in Palgrave Communications from Palgrave Macmillan
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().