Gait recognition using spatio-temporal representation fusion learning network with IMU-based skeleton graph and body partition strategy

Fo Hu, Qinxu Zheng, Xuanjie Ye, Zukang Qiao, Junlong Xiong and Hongsheng Chang

PLOS ONE, 2025, vol. 20, issue 10, 1-26

Abstract: The precise recognition of human lower limb movements based on wearable sensors is very important for human-computer interaction. However, the existing methods tend to ignore the dynamic spatial information in the process of executing human lower limb movements, leading to challenges such as reduced decoding accuracy and limited robustness. In this paper, we construct skeleton graph data based on inertial measurement unit (IMU) sensors. Also, a two-branch deep learning model, termed TCNN-MGCHN, is proposed to mine meaningful spatial and temporal feature representations from IMU-based skeleton graph data. Firstly, a temporal convolutional module (consisting of a multi-scale convolutional sub-module and an attention sub-module) is developed to extract temporal feature information with highly discriminative power. Secondly, a multi-scale graph convolutional module and a spatial graph edges’ importance weight assignment method based on body partitioning strategy are proposed to obtain intrinsic spatial feature information between different skeleton nodes. Finally, the fused spatio-temporal features are passed into the classification module to obtain the predicted gait movements and sub-phases. Extensive comparison and ablation studies are conducted on our self-constructed human lower limb movement dataset. The results demonstrate that TCNN-MGCHN delivers superior classification performance compared to the mainstream methods. This study can provide a benchmark for IMU-based human lower limb movement recognition and related deep-learning modeling works.

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0332947 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 32947&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0332947

DOI: 10.1371/journal.pone.0332947

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().