MPH-YOLO method for isolating the controller hand amidst multiple hands in digital interaction environments

Agustinus Rudatyo Himamunanto (), Supriadi Rustad (), Mochammad Arief Soeleman () and Guruh Fajar Shidik ()

Edelweiss Applied Science and Technology, 2025, vol. 9, issue 7, 665-675

Abstract: Hands play a vital role in human-computer interaction. However, ambiguity arises when multiple hand gestures appear within the same frame, leading to misinterpretation in gesture-controlled systems. This study proposes a hybrid method combining MediaPipe Hands (MPH) and a modified YOLO framework to isolate a single control hand using a visual marker. MPH detects hand landmarks, and YOLO identifies whether the hand contains a marker. Experiments involving 800 test videos showed that the method achieved 97.5% accuracy in correctly identifying the controller hand across various visual conditions. The proposed approach contributes to the robustness and precision of real-time gesture-based control systems.

Keywords: Gesture recognition; Hand isolation; Hand marker; MediaPipe Hands; YOLO. (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://learning-gate.com/index.php/2576-8484/article/view/8707/2913 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:ajp:edwast:v:9:y:2025:i:7:p:665-675:id:8707

Access Statistics for this article

More articles in Edelweiss Applied Science and Technology from Learning Gate
Bibliographic data for series maintained by Melissa Fernandes ().