DGFN Multimodal Emotion Analysis Model Based on Dynamic Graph Fusion Network

Jingwei Li, Xinyi Bai and Zhaoming Han
Additional contact information
Jingwei Li: College of Computer Science and Technology, Henan Institute of Technology, Xinxiang, China
Xinyi Bai: College of Computer Science and Technology, Henan Institute of Technology, Xinxiang, China
Zhaoming Han: College of Computer Science and Technology, Henan Institute of Technology, Xinxiang, China

International Journal of Decision Support System Technology (IJDSST), 2024, vol. 16, issue 1, 1-18

Abstract: In recent years, integrating text and image data for sentiment analysis in social networks has become a key approach. However, techniques for capturing complex cross-modal information and effectively fusing multimodal features still have shortcomings. We design a multimodal sentiment analysis model called the Dynamic Graph-Text Fusion Network (DGFN) to address these challenges. Text features are captured by leveraging the neighborhood information aggregation properties of Graph Convolutional Networks, treating words as nodes and integrating their features through their adjacency relationships. Additionally, the multi-head attention mechanism is utilized to extract rich semantic information from different subspaces simultaneously. For image feature extraction, a convolutional attention module is employed. Subsequently, an attention-based fusion module integrates the text and image features. Experimental results on the two datasets show significant improvements in sentiment classification accuracy and F1 scores, validating the effectiveness of the proposed DGFN model.

Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/IJDSST.352417 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jdsst0:v:16:y:2024:i:1:p:1-18

Access Statistics for this article

International Journal of Decision Support System Technology (IJDSST) is currently edited by Shaofeng Liu

More articles in International Journal of Decision Support System Technology (IJDSST) from IGI Global
Bibliographic data for series maintained by Journal Editor ().