A Dynamic Architecture to Control Multi-Rotors Using Hand Gestures

Nabeel Hussain ()
Additional contact information
Nabeel Hussain: Faculty of Information Technology & Computer Science, University of Central Punjab, Lahore

International Journal of Innovations in Science & Technology, 2024, vol. 6, issue 3, 1370-1385

Abstract: Traditional methods for controlling multi-rotors typically involve joysticks, radio controllers, and mobile applications. However, these methods pose significant challenges, particularly for novice users like farmers, due to the extensive training and understanding required to effectively operate a copter. This paper introduces a highly adaptable architecture designed to offer an end-to-end solution for controlling a copter using hand gestures. The proposed system leverages a depth sensor and Convolutional Neural Network (CNN) to recognize hand gestures, utilizing a custom dataset collected from both indoor and outdoor environments.Through a series of simulations with novice users, the system has demonstrated successful operation in real-world scenarios. Currently, the architecture can accurately recognize six distinct gestures with an average accuracy of 90.5% across three different test environments with varying lighting conditions. Key features of this proposed solution include its adaptability, reliable performance, especially in low-light conditions, and its user-friendly design, making it particularlywell-suited for farmers and other inexperienced users.

Keywords: UAV; Hand Gestures; Human Drone Interaction; Deep Learning; TensorFlow; CNN; Control Architecture. (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journal.50sea.com/index.php/IJIST/article/view/994/1591 (application/pdf)
https://journal.50sea.com/index.php/IJIST/article/view/994 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:abq:ijist1:v:6:y:2024:i:3:p:1370-1385

Access Statistics for this article

International Journal of Innovations in Science & Technology is currently edited by Prof. Dr. Syed Amer Mahmood

More articles in International Journal of Innovations in Science & Technology from 50sea
Bibliographic data for series maintained by Iqra Nazeer ().