Multi-Agent Decisional System Based on Emotion Recognition in Speech for Controlling Exceptional Situations in Robotic Production Processes

Olesea Borozan, Victor Ababii, Viorica Sudacevschi and Silvia Munteanu

Intellectus, 2024, issue 2, 192-200

Abstract: The paper proposes a multi-agent decision-making system designed to manage exceptional situations in robotic production processes by recognizing human emotions in speech. The importance of human-robot collaboration was highlighted, with a focus on automatically detecting human operators’ emotions as potential warning signals for technical or safety issues. This approach contributes to improving the safety and efficiency of the production process by enabling agents to quickly adjust system settings according to the emotions expressed by operators in speech, for example, in cases of stress or frustration. The paper details the structural and functional scheme of the system. It presents the mathematical model and shows how deep learning algorithms implemented through hybrid neural networks (CNN and RNN) enable the system to accurately recognize and classify emotional patterns in an audio signal. The technology uses Python libraries such as TensorFlow and Keras to analyze acoustic characteristics such as tone, intensity, rhythm, and timbre of the voice. These parameters are used to identify emotions and initiate proactive or automatic corrective actions in robotic processes. Thus, the multi-agent system provides an excellent level of human-robot interaction, optimizing both productivity and safety in complex and dynamic industrial environments.

Keywords: decision-making system; multi-agent system; emotions in speech; control system; exceptional situations; robotic processes; neural networks; sound processing; speech recognition; workplace health protection. (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

Downloads: (external link)
https://agepi.gov.md/sites/default/files/intellectus/Intellectus_2_2024_192.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:awf:journl:y:2024:i:2:p:192-200

DOI: 10.56329/1810-7087.24.2.18

Access Statistics for this article

More articles in Intellectus from State Agency on Intellectual Property (AGEPI)
Bibliographic data for series maintained by AGEPI ().