Artificial Intelligence Biosensing System on Hand Gesture Recognition for the Hearing Impaired

Kayal Padmanandam, Rajesh M. V., Ajay N. Upadhyaya, Ramesh Chandra K, Chandrashekar B, and Swati Sah
Additional contact information
Kayal Padmanandam: BVRIT Hyderabad College of Engineering for Women, India
Rajesh M. V.: Aditya Engineering College, India
Ajay N. Upadhyaya: SAL Engineering and Technical Institute, India
Ramesh Chandra K: Vishnu Institute of Technology, India
Chandrashekar B,: Sri Venkateswara College of Engineering and Technology, India
Swati Sah: Amity University, India

International Journal of Operations Research and Information Systems (IJORIS), 2022, vol. 13, issue 2, 1-13

Abstract: AI technologies have the potential to help deaf individuals communicate. Due to the complexity of sign fragmentation and the inadequacy of capturing hand gestures, the authors present a sign language recognition (SLR) system and wearable surface electromyography (sEMG) biosensing device based on a Deep SLR that converts sign language into printed message or speech, allowing people to better understand sign language and hand motions. On the forearms, two armbands containing a biosensor and multi-channel sEMG sensors are mounted to capture quite well arm and finger actions. Deep SLR was tested on an Android and iOS smartphone, and its usefulness was determined by comprehensive testing. Sign Speaker has a considerable limitation in terms of recognising two-handed signs with smartphone and smartwatch. To solve these issues, this research proposes a new real-time end-to-end SLR method. The average word error rate of continuous sentence recognition is 9.6%, and detecting signals and recognising a sentence with six sign words takes less than 0.9 s, demonstrating Deep SLR's recognition.

Date: 2022
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/IJORIS.306194 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:joris0:v:13:y:2022:i:2:p:1-13

Access Statistics for this article

International Journal of Operations Research and Information Systems (IJORIS) is currently edited by John Wang

More articles in International Journal of Operations Research and Information Systems (IJORIS) from IGI Global
Bibliographic data for series maintained by Journal Editor ().