Intelligent home interactive gesture recognition method based on multimodal feature fusion and DTW algorithm

Yan Luo and Zhaosheng Yang

International Journal of Product Development, 2025, vol. 29, issue 3/4, 415-439

Abstract: In order to improve the accuracy of smart home interactive gesture recognition, a smart home interactive gesture recognition method based on multimodal feature fusion and DTW algorithm is proposed. The sampled gesture data are subjected to moving average filtering, and the effective segments are extracted. A CR3D network model is constructed by integrating residual connections into the 3D-CNN framework and multimodal feature fusion is performed on the video frame sequence and the video optical flow frame sequence. Subsequently, the optimal warping path is determined using the DTW algorithm. The Euclidean distance is replaced by the cumulative distance to derive the gesture recognition result. The results show that the error rate is maintained below 0.5%, the coefficient of variation for the same gesture recognised across multiple users is 0 and the minimum recognition rate for multiple gesture categories reaches 96%. These findings indicate that the proposed method achieves high recognition accuracy.

Keywords: smart home; gesture recognition; multimodal feature fusion; CR3D network model; DTW algorithm. (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
http://www.inderscience.com/link.php?id=149699 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ids:ijpdev:v:29:y:2025:i:3/4:p:415-439

Access Statistics for this article

More articles in International Journal of Product Development from Inderscience Enterprises Ltd
Bibliographic data for series maintained by Sarah Parker ().