Translating Speech to Indian Sign Language Using Natural Language Processing

Purushottam Sharma (), Devesh Tulsian, Chaman Verma (), Pratibha Sharma and Nancy Nancy
Additional contact information
Purushottam Sharma: Amity School of Engineering & Technology, Amity University, Noida 201301, India
Devesh Tulsian: Amity School of Engineering & Technology, Amity University, Noida 201301, India
Chaman Verma: Department of Media and Educational Informatics, Faculty of Informatics, Eotvos Lorand University, 1053 Budapest, Hungary
Pratibha Sharma: Amity School of Engineering & Technology, Amity University, Noida 201301, India
Nancy Nancy: Amity School of Engineering & Technology, Amity University, Noida 201301, India

Future Internet, 2022, vol. 14, issue 9, 1-17

Abstract: Language plays a vital role in the communication of ideas, thoughts, and information to others. Hearing-impaired people also understand our thoughts using a language known as sign language. Every country has a different sign language which is based on their native language. In our research paper, our major focus is on Indian Sign Language, which is mostly used by hearing- and speaking-impaired communities in India. While communicating our thoughts and views with others, one of the most essential factors is listening. What if the other party is not able to hear or grasp what you are talking about? This situation is faced by nearly every hearing-impaired person in our society. This led to the idea of introducing an audio to Indian Sign Language translation system which can erase this gap in communication between hearing-impaired people and society. The system accepts audio and text as input and matches it with the videos present in the database created by the authors. If matched, it shows corresponding sign movements based on the grammar rules of Indian Sign Language as output; if not, it then goes through the processes of tokenization and lemmatization. The heart of the system is natural language processing which equips the system with tokenization, parsing, lemmatization, and part-of-speech tagging.

Keywords: Indian Sign Language; natural language processing; tokenization; lemmatization; parsing (search for similar items in EconPapers)
JEL-codes: O3 (search for similar items in EconPapers)
Date: 2022
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1999-5903/14/9/253/pdf (application/pdf)
https://www.mdpi.com/1999-5903/14/9/253/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jftint:v:14:y:2022:i:9:p:253-:d:897325

Access Statistics for this article

Future Internet is currently edited by Ms. Grace You

More articles in Future Internet from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().