Student engagement assessment using multimodal deep learning

Lijuan Yan, Xiaotao Wu and Yi Wang

PLOS ONE, 2025, vol. 20, issue 6, 1-19

Abstract: Student engagement assessment plays an important role in enhancing students’ positive performance and optimizing teaching methods. In this paper, a multimodal deep learning framework is proposed for student engagement assessment. Based on this framework, we propose a method for engagement assessment that utilizes data from three modalities: video, text, and logs. This method implements the extraction of engagement indicators, the fusion of asynchronous data, the use of deep learning models to evaluate engagement levels, and the use of gradient magnitude mapping to further distinguish subtle differences between engagement levels. In subsequent empirical studies, we explore the applicability of several popular deep CNN models in this method and validate the reliability of the engagement quantification results using statistical methods. The analysis results demonstrate that the framework, which combines multimodal asynchronous data fusion and deep learning models to assess engagement, is both effective and practical.

Date: 2025
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0325377 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 25377&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0325377

DOI: 10.1371/journal.pone.0325377

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().