3D Hand Gesture to Text and Speech Conversion Using Arduino and IMU Sensor

D. Regan, T. Thrisha, B. Venkata Nanda Kishore, K. Sujana, V. Yoganandareddy and G. Yaswanth

International Journal of Scientific Research in Science and Technology, 2026, vol. 13, issue 2, 507-515

Abstract: A hand gesture to speech and text conversion system in 3D that was designed to enhance communication with people with speech impairment. The system has been using a gesture glove, which is a wearable device, and it is connected to an IMU sensor (MPU6050) to record the actual hand orientation, motion, and finger gesture in real time. A sensor data is processed by an Arduino UNO which recognizes the predetermined gestures based on a threshold-based classification. The identified gestures appear on an LCD of size 16x 2 in form of text that is sent wirelessly via a Bluetooth (HC-05) module to a mobile phone to be read out. Buzzer will act as instant feedback when there is a successful gesture recognition and a battery supply is used to create portability. Serious outcomes of the experiments show that the system is an effective low-cost, user-friendly assistive communication aid to speech- and hearing-impaired users because its gesture recognition is performed in real-time with a low latency.

Keywords: 3D hand gesture recognition; IMU sensor; MPU6050; Arduino UNO; gesture-to-text conversion; gesture-to-speech conversion; wearable assistive device; Bluetooth HC-05; embedded system; real-time gesture processing; human-computer interaction (search for similar items in EconPapers)
Date: 2026
References: Add references at CitEc
Citations:

Downloads: (external link)
https://ijsrst.com/home/article/view/IJSRST2613320 Abstract page (text/html)
https://ijsrst.com/home/article/download/IJSRST2613320/IJSRST2613320 Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:etm:ijsrst:v13:y2026:i2:id:1479

DOI: 10.32628/IJSRST2613320

Access Statistics for this article

More articles in International Journal of Scientific Research in Science and Technology from Technoscience Academy
Bibliographic data for series maintained by Pankaj Sharma ().