Transformer-Based Sentiment Analysis for classification of non-depressive and suicidal thought from Bangla Text

Md. Samiul Islam, Rafiul Hoque, Sagor Sarkar, Md. Rajibul Palas, Md. Moshiur Rahman and Muhammad Hoque
Additional contact information
Md. Samiul Islam: Green University of Bangladesh, Dhaka, Bangladesh
Rafiul Hoque: Green University of Bangladesh, Dhaka, Bangladesh
Sagor Sarkar: Green University of Bangladesh, Dhaka, Bangladesh
Md. Rajibul Palas: Green University of Bangladesh, Dhaka, Bangladesh
Md. Moshiur Rahman: Bangabandhu Sheikh Mujibur Rahman Digital University, Bangladesh
Muhammad Hoque: Sefako Makgatho Health Sciences University

International Journal of Research in Business and Social Science (2147-4478), 2025, vol. 14, issue 5, 449-463

Abstract: The growing prevalence of mental health issues, particularly depression and suicidal thoughts, points to the need to develop automated tools capable of detecting such sentiments from online communication. This study addresses some critical challenges by introducing a novel sentiment analysis framework for Bangla text, aimed at classifying content into non-depressive, depressive, and suicidal categories. We propose a hybrid deep learning model leveraging the strengths of transformer-based architectures, designed to manage long textual sequences effectively, a critical aspect in the context of natural language processing. Our model integrates RoBERTa (Robustly Optimised BERT Pre-Training Approach) with a Self-Attention Network (SAN), creating a synergistic framework for nuanced sentiment detection in Bangla social media posts, comments, and articles. This method addresses the scarcity of Bangla specific datasets by utilising a dataset curated for the study. The results demonstrate the superiority of our model, achieving an accuracy of 82.58%, alongside precision, recall, and F1-scores of 82%. Subsequently, it emphasises the potential for the proposed model to support early identification of mental health concerns, thereby enabling timely interventions and contributing to mental health awareness and prevention efforts. In the future, deploying the model as a real-time chatbot or browser extension could scan Bangla social media for depressive, non-depressive, and suicidal content and alert professionals to the risk factors. Key Words:Deep Learning, RoBERTa, SAN, Bangla Language, Mental Health

Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://ssbfnet.com/ojs/index.php/ijrbs/article/view/4274/2892 (application/pdf)
https://doi.org/10.20525/ijrbs.v14i5.4274 (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:rbs:ijbrss:v:14:y:2025:i:5:p:449-463

Access Statistics for this article

International Journal of Research in Business and Social Science (2147-4478) is currently edited by Prof.Dr.Umit Hacioglu

More articles in International Journal of Research in Business and Social Science (2147-4478) from Center for the Strategic Studies in Business and Finance Editorial Office,Baris Mah. Enver Adakan Cd. No: 5/8, Beylikduzu, Istanbul, Turkey. Contact information at EDIRC.
Bibliographic data for series maintained by Umit Hacioglu ().