Defining and Analyzing Nervousness Using AI-Based Facial Expression Recognition

Hyunsoo Seo, Seunghyun Kim and Eui Chul Lee ()
Additional contact information
Hyunsoo Seo: The Seoul Institute, Seoul 05006, Republic of Korea
Seunghyun Kim: Department of Human-Centered Artificial Intelligence, Sangmyung University, Seoul 03016, Republic of Korea
Eui Chul Lee: Department of Human-Centered Artificial Intelligence, Sangmyung University, Seoul 03016, Republic of Korea

Mathematics, 2025, vol. 13, issue 11, 1-17

Abstract: Nervousness is a complex emotional state characterized by high arousal and ambiguous valence, often triggered in high-stress environments. This study presents a mathematical and computational framework for defining and classifying nervousness using facial expression data projected onto a valence–arousal (V–A) space. A statistical approach employing the Minimum Covariance Determinant (MCD) estimator is used to construct 90% and 99% confidence ellipses for nervous and non-nervous states, respectively, using Mahalanobis distance. These ellipses form the basis for binary labeling of the AffectNet dataset. We apply a deep learning model trained via knowledge distillation, with EmoNet as the teacher and MobileNetV2 as the student, to efficiently classify nervousness. The experimental results on the AffectNet dataset show that our proposed method achieves a classification accuracy of 81.08%, improving over the baseline by approximately 6%. These results are obtained by refining the valence–arousal distributions and applying knowledge distillation from EmoNet to MobileNetV2. We use accuracy and F1-score as evaluation metrics to validate the performance. Furthermore, we perform a qualitative analysis using action unit (AU) activation graphs to provide deeper insight into nervous facial expressions. The proposed method demonstrates how mathematical tools and deep learning can be integrated for robust affective state modeling.

Keywords: affective computing; facial expression recognition; nervousness; knowledge distillation; action units (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/13/11/1745/pdf (application/pdf)
https://www.mdpi.com/2227-7390/13/11/1745/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:13:y:2025:i:11:p:1745-:d:1663876

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().