Emotion and Intention Detection in a Large Language Model

Emmanuel Castro, Hiram Calvo () and Olga Kolesnikova
Additional contact information
Emmanuel Castro: Centro de Investigación en Computación, Instituto Politécnico Nacional, Mexico City 07738, Mexico
Hiram Calvo: Centro de Investigación en Computación, Instituto Politécnico Nacional, Mexico City 07738, Mexico
Olga Kolesnikova: Centro de Investigación en Computación, Instituto Politécnico Nacional, Mexico City 07738, Mexico

Mathematics, 2025, vol. 13, issue 23, 1-37

Abstract: Large language models (LLMs) have recently shown remarkable capabilities in natural language processing. In this work, we investigate whether an advanced LLM can recognize user emotions and intentions from text, focusing on the open-source model DeepSeek. We evaluate zero-shot emotion classification and dialog act (intention) classification using two benchmark conversational datasets (IEMOCAP and MELD). We test the model under various prompting conditions, including those with and without conversational context, as well as with auxiliary information (dialog act labels or emotion labels). Our results show that DeepSeek achieves an accuracy of up to 63% in emotion recognition on MELD, utilizing context and dialog-act information. In the case of intention recognition, the model improved from 45% to 61% with the aid of context, but no further improvement was observed with the provision of emotional cues. Supporting the hypothesis that providing conversational context aids emotion and intention detection. However, conversely, adding emotion cues did not enhance intent classification, suggesting an asymmetric relationship. These findings highlight both the potential and limitations of current LLMs in understanding affective and intentional aspects of dialogue. For comparison, we also ran the same emotion and intention detection tasks on GPT-4 and Gemini-2.5. DeepSeek-r1 performed as well as Gemini-2.5 and better than GPT-4, confirming its place as a strong, competitive model in the field.

Keywords: large language models; emotion recognition; intent detection; dialogue acts; conversational AI; zero-shot learning (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/13/23/3768/pdf (application/pdf)
https://www.mdpi.com/2227-7390/13/23/3768/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:13:y:2025:i:23:p:3768-:d:1801623

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().