Estimating the Reliability of Skill Transitions in Longitudinal Diagnostic Classification Models

Madeline A. Schellman and Matthew J. Madison
Additional contact information
Madeline A. Schellman: University of Georgia
Matthew J. Madison: University of Georgia

Journal of Educational and Behavioral Statistics, 2025, vol. 50, issue 4, 604-631

Abstract: Diagnostic classification models (DCMs) have grown in popularity as stakeholders increasingly desire actionable information related to students’ skill competencies. Longitudinal DCMs offer a psychometric framework for providing estimates of students’ proficiency status transitions over time. For both cross-sectional and longitudinal DCMs, it is important that researchers estimate and report reliability so stakeholders and end-users can evaluate the trustworthiness of results. Over the past decade, researchers have developed and applied various metrics for reliability in the DCM framework. This study extends these metrics onto the longitudinal DCM context and consists of three parts: (a) the theory and development of the new longitudinal DCM reliability metrics, (b) a simulation study to examine the performance of the developed metrics and establish thresholds, and (c) an empirical data analysis to illustrate an application of the developed metrics. This paper concludes with a discussion of our recommendations for applying the developed metrics.

Keywords: diagnostic classification model; cognitive diagnosis model; longitudinal; reliability; precision; latent transition; growth (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.sagepub.com/doi/10.3102/10769986241256032 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:sae:jedbes:v:50:y:2025:i:4:p:604-631

DOI: 10.3102/10769986241256032

Access Statistics for this article

More articles in Journal of Educational and Behavioral Statistics
Bibliographic data for series maintained by SAGE Publications ().