Indian Sign Language Detection and Translation using Machine Learning in English

Priyal, Vanshika, Khushi Koli and Khyati Ahlawat

International Journal of Scientific Research in Science and Technology, 2025, vol. 12, issue 2, 926-937

Abstract: Indian Sign Language (ISL) is a critical means of communication for India's deaf and hard-of-hearing population of millions. However, the lack of accessible tools prevents their communication with non-ISL speakers and leaves them vulnerable to social isolation. To address this lack, this study proposes a gesture recognition system for ISL-to-speech translation using machine learning algorithms—Support Vector Machine (SVM), k-Nearest Neighbors (k-NN), and Recurrent Neural Networks (RNN). A performance-evaluating dataset with all ISL alphabets, comprising 20 frames per sign, was generated. The evaluation in static and dynamic gesture recognition indicates the performance of these models, with RNN being the most appropriate for the dynamic sequence. Real-time experimentation using webcam input confirmed the flexibility of the developed approach, indicating more than 90% accuracy by using preprocessing methods. Moreover, the combination with Google Text-to-Speech (gTTS) also enables enhanced real-time translation, thus allowing the system to be applicable for real-world uses. The outputs offer a model for building mobile applications and public service tools to enable inclusive communication. Future work will add more data to the dataset, improve recognition of complex gestures, and incorporate context-aware comprehension in order to enhance the functionality of the system.

Keywords: ISL - Indian Sign Language (ISL); Gesture Recognition; Recurrent Neural Networks (RNN); Long Short-Term Memory (LSTM); Support Vector Machines (SVM); k-Nearest Neighbors (k-NN); Google text to speech (gTTS) (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://ijsrst.com/home/article/view/IJSRST251222642 Abstract page (text/html)
https://ijsrst.com/home/article/download/IJSRST251222642/IJSRST251222642 Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:etm:ijsrst:v12:y2025:i2:id:747

DOI: 10.32628/IJSRST251222642

Access Statistics for this article

More articles in International Journal of Scientific Research in Science and Technology from Technoscience Academy
Bibliographic data for series maintained by Pankaj Sharma ().