The Integration of OpenCV and Unity for the Development of Interactive Educational Game

Jinish Shah, Pradhyuman Pandey, Tanmai Kamat and Prachi Tawde

International Journal of Scientific Research in Computer Science, Engineering and Information Technology, 2023, vol. 9, issue 4, 425-431

Abstract: In recent years, online and interactive educational games have become increasingly popular as a tool to improve and accelerate the learning experience for students. Computer vision libraries in python such as OpenCV provide a wide range of tools for image processing, object detection, and face recognition that can be used to create interactive and engaging games. This paper explores the use of OpenCV in Unity 3D for the development of interactive online educational games. Specifically, we discuss how OpenCV can be used to create interactive games that respond to user actions in real-time, such as tracking the movement of a user’s hand or face to control in-game actions. It focuses on an unconventional approach to interactive game development using OpenCV combined with a computer network based protocol namely User Datagram Protocol (UDP) as communication channel to transfer real-time data to Unity Game Engine from Python Server. Though being the conventional approach for object and face tracking based games Augmented Reality (AR) requires specialized hardware and high camera quality for accurate tracking of object position and orientation. Given the lack of technical infrastructure and computational resources in majority government schools under the Indian academic education system this approach is not feasible for large scale implementation. This research paper aims to contribute to the development of innovative and effective approaches for interactive and online educational games suitable for large scale implementation in the form of a Vlab (Virtual Lab).

Keywords: OpenCV; Interactive educational game; Unity 3D; Computer Vision; User Datagram Protocol (UDP) (search for similar items in EconPapers)
Date: 2023
Note: Article URL: https://ijsrcseit.com/CSEIT2390452
References: Add references at CitEc
Citations:

Downloads: (external link)
https://ijsrcseit.com/CSEIT2390452 Article URL (text/html)
https://ijsrcseit.com/paper/CSEIT2390452.pdf Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:jbh:ijsrcs:v9:y2023:i4:id:hcseit2390452

DOI: 10.32628/CSEIT2390452

Access Statistics for this article

More articles in International Journal of Scientific Research in Computer Science, Engineering and Information Technology from International Journal of Scientific Research in Computer Science, Engineering and Information Technology
Bibliographic data for series maintained by Pankaj Sharma (USA) ().