Fine-Grained Action Analysis for Automated Skill Assessment and Feedback in Instructional Videos

Gengrui Wei, Xu Wang and Zhong Chu

Pinnacle Academic Press Proceedings Series, 2025, vol. 2, 96-107

Abstract: Fine-grained action analysis in instructional videos presents significant challenges due to subtle motion variations and complex temporal dependencies. This paper introduces a comprehensive framework for automated skill assessment and feedback generation based on granularity-aware feature extraction and multi-modal fusion techniques. The proposed approach incorporates a temporal self-similarity module that captures periodic patterns critical for skill quality assessment, a part-level feature extraction network that analyzes body part movements, and a cross-attention transformer architecture that integrates skeleton and RGB modalities. Experiments conducted on our newly collected Skill Video dataset, comprising 8450 instructional videos across sports, crafts, medical procedures, and musical performances, demonstrate substantial improvements over state-of-the-art methods. The framework achieves 89.5% accuracy in skill level classification, a 20.1% reduction in dimensional assessment error, and a 5.8% improvement in temporal action quality estimation compared to existing approaches. User studies with 45 participants reveal that feedback generated by our system produces learning outcomes comparable to human expert guidance, with only a 3.6% gap in skill improvement and 2.6% difference in retention, as supported by rigorous experimental design and statistical analysis. The proposed technology enables personalized learning experiences through continuous assessment and feedback, with applications spanning formal education, professional training, and self-directed learning environments.

Keywords: fine-grained action recognition; skill assessment; multi-modal fusion; automated feedback generation (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://pinnaclepubs.com/index.php/PAPPS/article/view/117/118 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:dba:pappsa:v:2:y:2025:i::p:96-107

Access Statistics for this article

More articles in Pinnacle Academic Press Proceedings Series from Pinnacle Academic Press
Bibliographic data for series maintained by Joseph Clark ().