Determining Emotion Intensities from Audio Data Using a Convolutional Neural Network

Simon Kipyatich Kiptoo, Kennedy Ogada () and Tobias Mwalili ()
Additional contact information
Simon Kipyatich Kiptoo: Jomo Kenyatta University of Agriculture and Technology
Kennedy Ogada: Jomo Kenyatta University of Agriculture and Technology
Tobias Mwalili: Jomo Kenyatta University of Agriculture and Technology

A chapter in Artificial Intelligence Tools and Applications in Embedded and Mobile Systems, 2024, pp 125-138 from Springer

Abstract: Abstract Human beings communicate their feelings in the form of emotions. The feelings are expressed via speech, facial expressions, gestures, or other non-verbal signs. An emotion is a complex severe disturbance of an individual’s mental state that involves a subjective experience coupled with physiological, behavioral, and expressive responses. It denotes the mental state of the human mind and thought processes that represent a recognizable pattern. The emotions can be expressed with normal intensity or strong intensity depending on the incident being communicated. Detecting and classifying these emotions encompasses three fundamental machine learning processes; Feature Extraction, Feature Selection, and Feature Classification. Machine learning is the science of making computers learn and act like humans, while enhancing the learning with time in an independent manner, by giving them data and information in the form of observations and real-world interactions. A multi-modal approach comprising several machine learning algorithms is required to map out the intensities contained in the emotion classes. Mel Frequency Cepstral Coefficients are a set of about 10–20 features obtained from a speech signal describing the overall shape of a spectral envelope. The MFCC algorithm is designed to mimic the human hearing, thus it is ideal for this experiment.

Keywords: Emotion; Emotion intensity; CNN; MFCC (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:prochp:978-3-031-56576-2_12

Ordering information: This item can be ordered from
http://www.springer.com/9783031565762

DOI: 10.1007/978-3-031-56576-2_12

Access Statistics for this chapter

More chapters in Progress in IS from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().