A Two-Stage Multi-Modal Multi-Label Emotion Recognition Decision System Based on GCN

Weiwei Wu, Daomin Chen and Qingping Li
Additional contact information
Weiwei Wu: Zhejiang Yuying College of Vocational Technology, China
Daomin Chen: Guangdong University of Science and Technology, China
Qingping Li: Zhejiang Yuying College of Vocational Technology, China

International Journal of Decision Support System Technology (IJDSST), 2024, vol. 16, issue 1, 1-17

Abstract: Compared with single-modal methods, emotion recognition research is increasingly focusing on the use of multi-modal methods to improve accuracy. Despite the advantages of multimodality, challenges such as feature fusion and redundancy remain. In this study, we propose a multi-modal multi-label emotion recognition decision system based on graph convolution. Our approach utilizes text, speech, and video data for feature extraction, while combining tag attention to capture fine-grained modal dependencies. The two-stage feature reconstruction module facilitates complementary feature fusion while preserving mode-specific information. Emotional decisions are made using a fully connected layer to optimize performance without adding complexity to the model. Experimental results on IEMOCAP, CMU-MOSEI and MELD datasets show that our algorithm has higher accuracy than existing models, highlighting the effectiveness and innovation of our proposed algorithm.

Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve.aspx?doi=10.4018/IJDSST.352398 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jdsst0:v:16:y:2024:i:1:p:1-17

Access Statistics for this article

International Journal of Decision Support System Technology (IJDSST) is currently edited by Shaofeng Liu

More articles in International Journal of Decision Support System Technology (IJDSST) from IGI Global
Bibliographic data for series maintained by Journal Editor ().