Enhancing Education and Interaction for the Visually Impaired Using Deep Learning and IoT

Sanjit Kumar Dash, Rudra Madhav Biswal, Aisurya Misra, Rajesh Swain, Saswat Ray and Jibitesh Mishra
Additional contact information
Sanjit Kumar Dash: Odisha University of Technology and Research, Bhubaneswar, India
Rudra Madhav Biswal: Odisha University of Technology and Research, Bhubaneswar, India
Aisurya Misra: Odisha University of Technology and Research, Bhubaneswar, India
Rajesh Swain: Odisha University of Technology and Research, Bhubaneswar, India
Saswat Ray: Odisha University of Technology and Research, Bhubaneswar, India
Jibitesh Mishra: Odisha University of Technology and Research, Bhubaneswar, India

International Journal of Mobile Human Computer Interaction (IJMHCI), 2021, vol. 13, issue 1, 1-16

Abstract: Education for all has been a fundamental ideology behind the prosperity and development of a nation. The proposed system based on IoT aims to improve the quality of education and interaction for the visually challenged through object classification, learning, and digital library. This paper introduces a deep learning enabled percussive methodology for interaction of the blind. The methodology proposed in this work takes recorded audio as input and performs classification based on certain characteristics in order to determine a knock pattern. A proof-of-concept wearable device is introduced allowing visually challenged persons to passively read braille by stimulation on the skin of the forearm. A web application is designed that enables any ebook to be streamed via this web application to the wearable device. An Android application is presented that serves as an application to assist in daily life activities. The proposed system is tested on two different categories of subjects consisting of visually impaired and blindfolded people.

Date: 2021
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 18/IJMHCI.2021010101 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jmhci0:v:13:y:2021:i:1:p:1-16

Access Statistics for this article

International Journal of Mobile Human Computer Interaction (IJMHCI) is currently edited by Joanna Lumsden

More articles in International Journal of Mobile Human Computer Interaction (IJMHCI) from IGI Global
Bibliographic data for series maintained by Journal Editor ().