The Serbian Sign Language Alphabet: A Unique Authentic Dataset of Letter Sign Gestures

Mladen Radaković (), Marina Marjanović, Ivana Ristić, Valentin Kuleto, Milena P. Ilić and Svetlana Dabić-Miletić
Additional contact information
Mladen Radaković: Information Technology School—ITS, 11000 Belgrade, Serbia
Marina Marjanović: Faculty of Technical Sciences, Singidunum University, 11000 Belgrade, Serbia
Ivana Ristić: Teacher Education Faculty, University of Priština in Kosovska Mitrovica, 38219 Kosovska Mitrovica, Serbia
Valentin Kuleto: Information Technology School—ITS, 11000 Belgrade, Serbia
Milena P. Ilić: Information Technology School ITS—Belgrade, LINK Group Belgrade, Faculty of Contemporary Arts Belgrade, University Business Academy in Novi Sad, 11000 Belgrade, Serbia
Svetlana Dabić-Miletić: Faculty of Transport and Traffic Engineering, University of Belgrade, 11000 Belgrade, Serbia

Mathematics, 2024, vol. 12, issue 4, 1-21

Abstract: Language barriers and the communication difficulties of individuals with developmental disabilities are two major causes of communication problems that societies worldwide encounter. A particularly challenging group is hearing-impaired people who have difficulties with communication, reading, writing, learning, and social interactions, which have a substantial impact on their quality of life. This article focuses on detailing a Serbian Sign Language alphabet database and the method for creating it in order to provide a foundation for answering the various societal challenges of persons who use the Serbian language. In front of a computer camera, 41 people performed Serbian Sign Language sign movements that replicated the Serbian alphabet for this study’s aims. Hand and body key points were identified using the recorded video clips, and the numerical values of the identified key points were then stored in a database for further processing. In total, 8.346 video clips of people making recognized hand gestures were gathered, processed, classed, and archived. This paper provides a thorough technique that may be applied to comparable tasks and details the process of constructing a dataset based on Serbian Sign Language alphabet signs. This dataset was created using custom-made Python 3.11 software. Data regarding dynamic video clips that capture entire subject movement were incorporated into this dataset to fill in the gaps in other similar efforts based on static photographs. Thus, the purpose of this investigation is to employ innovative technology to support the community of hearing-impaired people in areas such as general inclusion, education, communication, and empowerment.

Keywords: Serbian Sign Language; hearing-impaired persons; inclusion; machine learning; artificial intelligence; gestures (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/12/4/525/pdf (application/pdf)
https://www.mdpi.com/2227-7390/12/4/525/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:12:y:2024:i:4:p:525-:d:1335649

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().