AI Vision for Health Care: Virtual Keyboard and Mouse Empowering Partially Disabled Patients

Sabeen Zulfiqar, Ahad Abbas, Mehroz, Engr. Muhammad Farooq, Ihsan Ul Haq
Additional contact information
Sabeen Zulfiqar, Ahad Abbas, Mehroz, Engr. Muhammad Farooq, Ihsan Ul Haq: DepartmentofElectricalEngineering,UniversityofEngineeringand Technology,Peshawar, Pakistan. DepartmentofEnergyEngineering, University of Hull,England,UnitedKingdom

International Journal of Innovations in Science & Technology, 2025, vol. 7, issue 7, 307-315

Abstract: This paper introduces a machine-learning-based virtual keyboard and mouse system designed to assist individuals with physical disabilities. The system recognizes hand gestures using computer vision techniques and translates them into keyboard inputs and mouse controls. By utilizing Convolutional Neural Networks (CNNs) and the YOLOv8 model, the system achieves real-time performance with an average accuracy of 92%, enabling touchless interaction with computers. The solution uses widely available hardware like standard webcams, making it accessible, affordable, and easy to deploy. This system improves the usability of computing devices for people with motor impairments, offering an innovative, touchless alternative to traditional input methods. It also supports essential tasks such as scrolling, clicking, and zooming through simple gestures. The framework is adaptable to various environments, ensuring it is easy to use in different settings. Our system offers a complete virtual keyboard and mouse solution using a common webcam and real-time gesture recognition, making computer use easier and more affordable for users with motor impairment

Keywords: Virtual Keyboard; Virtual Mouse; YOLOv8; PyAutoGUI; Gesture Recognition; Computer Vision; CNN; OpenCV; Tkinter (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://journal.50sea.com/index.php/IJIST/article/view/1300/1864 (application/pdf)
https://journal.50sea.com/index.php/IJIST/article/view/1300 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:abq:ijist1:v:7:y:2025:i:7:p:307-315

Access Statistics for this article

International Journal of Innovations in Science & Technology is currently edited by Prof. Dr. Syed Amer Mahmood

More articles in International Journal of Innovations in Science & Technology from 50sea
Bibliographic data for series maintained by Iqra Nazeer ().