Multimodal student behavior analysis based on unsupervised learning

Zhilin Chen () and Vladimir Y. Mariano ()

Edelweiss Applied Science and Technology, 2025, vol. 9, issue 4, 244-261

Abstract: This study applies unsupervised learning to multimodal data for analyzing student behavior patterns, aiming to discover intrinsic behavioral structures without predetermined categories. The research integrates video, audio, digital interaction, and physiological signals across diverse educational settings. The framework employs self-supervised representation learning, multi-view clustering, and temporal pattern mining to analyze synchronized multimodal data streams from classroom, online, and laboratory environments. Five distinct behavioral clusters were identified, showing significant correlations with academic outcomes. The temporal stability of behavioral states emerged as a stronger predictor of achievement than frequency. The multimodal approach demonstrated superior performance compared to single-modality analyses in capturing behavioral transitions and detecting disengagement. Unsupervised multimodal analysis effectively reveals naturally occurring behavioral patterns adaptable across diverse educational contexts, establishing a methodological foundation beyond predefined categories. The approach enables earlier intervention for struggling students, improving upon traditional identification methods. These findings support the development of adaptive educational technologies that respond to students' behavioral states in real-time, enhancing personalized learning experiences.

Keywords: Intrinsic behavioral structures; Multimodal data; Multi-view clustering; Predefined categories; Student behavior patterns. (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://learning-gate.com/index.php/2576-8484/article/view/5958/2153 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ajp:edwast:v:9:y:2025:i:4:p:244-261:id:5958

Access Statistics for this article

More articles in Edelweiss Applied Science and Technology from Learning Gate
Bibliographic data for series maintained by Melissa Fernandes ().