A Multimodal Sentiment Analysis Model for Graphic Texts Based on Deep Feature Interaction Networks

Wanjun Chang and Dongfang Zhang
Additional contact information
Wanjun Chang: College of Computer Science & Technology, Henan Institute of Technology, Xinxiang, China
Dongfang Zhang: College of Computer Science & Technology, Henan Institute of Technology, Xinxiang, China

International Journal of Ambient Computing and Intelligence (IJACI), 2024, vol. 15, issue 1, 1-19

Abstract: Due to the widespread adoption of social networks, image-text comments have become a prevalent mode of emotional expression compared to traditional text descriptions. However, there are currently two major challenges. The first is the question of how to extract rich representations effectively from both text and images, and the second is the question of how to extract cross-modal shared emotion features. This study proposes a multimodal sentiment analysis method based on a deep feature interaction network (DFINet). It leverages word-to-word graphs and deep attention interaction networks (DAIN) to learn text representations effectively from multiple subspaces. Additionally, it introduces a cross-modal attention interaction network to extract cross-modal shared emotion features efficiently. This approach helps alleviate the difficulties associated with acquiring image-text features and representing cross-modal shared emotion features. Experimental results on the Yelp dataset demonstrate the effectiveness of the DFINet method.

Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/IJACI.355192 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jaci00:v:15:y:2024:i:1:p:1-19

Access Statistics for this article

International Journal of Ambient Computing and Intelligence (IJACI) is currently edited by Nilanjan Dey

More articles in International Journal of Ambient Computing and Intelligence (IJACI) from IGI Global
Bibliographic data for series maintained by Journal Editor ().