Leveraging Chain-of-Thought to Enhance Stance Detection with Prompt-Tuning

Daijun Ding, Xianghua Fu, Xiaojiang Peng, Xiaomao Fan, Hu Huang () and Bowen Zhang ()
Additional contact information
Daijun Ding: College of Applied Science, Shenzhen University, Shenzhen 518052, China
Xianghua Fu: College of Big Data and Internet, Shenzhen Technology University, Shenzhen 518118, China
Xiaojiang Peng: College of Big Data and Internet, Shenzhen Technology University, Shenzhen 518118, China
Xiaomao Fan: College of Big Data and Internet, Shenzhen Technology University, Shenzhen 518118, China
Hu Huang: Shenzhen Graduate School, Peking University, Shenzhen 518055, China
Bowen Zhang: College of Big Data and Internet, Shenzhen Technology University, Shenzhen 518118, China

Mathematics, 2024, vol. 12, issue 4, 1-16

Abstract: Investigating public attitudes towards social media is crucial for opinion mining systems to gain valuable insights. Stance detection, which aims to discern the attitude expressed in an opinionated text towards a specific target, is a fundamental task in opinion mining. Conventional approaches mainly focus on sentence-level classification techniques. Recent research has shown that the integration of background knowledge can significantly improve stance detection performance. Despite the significant improvement achieved by knowledge-enhanced methods, applying these techniques in real-world scenarios remains challenging for several reasons. Firstly, existing methods often require the use of complex attention mechanisms to filter out noise and extract relevant background knowledge, which involves significant annotation efforts. Secondly, knowledge fusion mechanisms typically rely on fine-tuning, which can introduce a gap between the pre-training phase of pre-trained language models (PLMs) and the downstream stance detection tasks, leading to the poor prediction accuracy of the PLMs. To address these limitations, we propose a novel prompt-based stance detection method that leverages the knowledge acquired using the chain-of-thought method, which we refer to as PSDCOT. The proposed approach consists of two stages. The first stage is knowledge extraction, where instruction questions are constructed to elicit background knowledge from a VLPLM. The second stage is the multi-prompt learning network (M-PLN) for knowledge fusion, which learns model performance based on the background knowledge and the prompt learning framework. We evaluated the performance of PSDCOT on publicly available benchmark datasets to assess its effectiveness in improving stance detection performance. The results demonstrate that the proposed method achieves state-of-the-art results in in-domain, cross-target, and zero-shot learning settings.

Keywords: stance detection; prompt-tuning; chain-of-thought (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2024
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/12/4/568/pdf (application/pdf)
https://www.mdpi.com/2227-7390/12/4/568/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:12:y:2024:i:4:p:568-:d:1338448

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().