A COMPARATIVE STUDY USING 2D CNN AND TRANSFER LEARNING TO DETECT AND CLASSIFY ARABIC-SCRIPT-BASED SIGN LANGUAGE

Karwan Mahdi Hama Rawf (), Aree Ali Mohammed, Ayub Othman Abdulrahman, Peshraw Ahmed Abdalla and Karzan J. Ghafor
Additional contact information
Karwan Mahdi Hama Rawf: Computer Science Department, College of Science, University of Halabja, KRG, Halabja, Iraq
Aree Ali Mohammed: Computer Science Department, College of Science, University of Halabja, KRG, Halabja, Iraq
Ayub Othman Abdulrahman: Computer Science Department, College of Science, University of Halabja, KRG, Halabja, Iraq
Peshraw Ahmed Abdalla: Computer Science Department, College of Science, University of Halabja, KRG, Halabja, Iraq
Karzan J. Ghafor: Computer Science Department, College of Science, University of Halabja, KRG, Halabja, Iraq

Acta Informatica Malaysia (AIM), 2023, vol. 7, issue 1, 08-14

Abstract: Nowadays, Sign Language Recognition (SLR) plays a significant impact in the disabled community because it is utilized as a learning tool for everyday tasks like interaction, education, training, and human activities. All three of these languages—Arabic, Persian, and Kurdish—share the same writing system, called the Arabic script. In order to categorize sign languages written in the Arabic alphabet, this article employs convolutional neural networks (CNN) and transfer learning (mobileNet) methods. The study’s primary goal is to develop a common standard for alphabetic sign language in Arabic, Persian, and Kurdish. Different activation functions were used throughout the model’s extensive training on the ASSL2022 dataset. There are a total of 81857 images included in the collection, gathered from two sources and representing the 40 Arabic-script-based alphabets. As can be seen from the data obtained, the proposed models perform well, with an average training accuracy of 99.7% for CNN and 99.32% for transfer learning. When compared to other research involving languages written in the Arabic script, this one achieves better detection and identification accuracy.

Keywords: Sign language; Arabic-script; CNN; Transfer learning; ASSL2022 (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://actainformaticamalaysia.com/archives/AIM/1aim2023/1aim2023-08-14.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zib:zbnaim:v:7:y:2023:i:1:p:08-14

DOI: 10.26480/aim.01.2023.08.14

Access Statistics for this article

Acta Informatica Malaysia (AIM) is currently edited by Associate Professor Dr. Shahreen Kasim

More articles in Acta Informatica Malaysia (AIM) from Zibeline International Publishing
Bibliographic data for series maintained by Zibeline International Publishing ( this e-mail address is bad, please contact ).