Feature fusion based transformer for sentiment analysis in social networks

Shiyong Li, He Li, Juan Du, Shitao Yan and Chuang Dong

PLOS ONE, 2025, vol. 20, issue 11, 1-23

Abstract: Sentiment analysis methods aim to evaluate users’ mental health conditions by analyzing their posted content (text, images, and audio) on social networks. However, given the diversity and complexity of social media information, traditional single-modal sentiment analysis techniques exhibit limitations in accurately interpreting users’ emotional states and may even lead to contradictory conclusions. To address this challenge, this paper proposes a Feature Fusion Based Transformer (FFBT) solution. The framework consists of three key steps: Firstly, RoBERTa and ResNet50 models are employed to extract features from textual and image data in social media posts, respectively. Then, a multimodal Transformer architecture facilitates feature alignment and fusion across different modalities. Finally, the fused features are fed into a fully connected network (FCN) for sentiment classification, ultimately determining the user’s emotional state. Experiments conducted on a custom dataset constructed from social media platform data demonstrate that FFBT outperforms existing sentiment analysis algorithms by 4.1% in accuracy and 5% in F1-scores, respectively.

Date: 2025
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0333416 (text/html)
https://journals.plos.org/plosone/article/file?id= ... 33416&type=printable (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:plo:pone00:0333416

DOI: 10.1371/journal.pone.0333416

Access Statistics for this article

More articles in PLOS ONE from Public Library of Science
Bibliographic data for series maintained by plosone ().