Efficient Deception Detection Using Multimodal Facial and Audio Transcript Features

Radhika Thakkar and Sheshang Degadwala

International Journal of Scientific Research in Science and Technology, 2025, vol. 12, issue 3, 397-402

Abstract: This paper presents an efficient deception detection framework leveraging multi-modal facial and audio transcript features, achieving a notable 91.2% accuracy using a Modified Convolution Neural Network (Mod CNN) model. Deception detection, a critical challenge in security, forensic, and psychological analysis, benefits significantly from the integration of multi-modal data that captures subtle cues beyond verbal content. The proposed method fuses spatial-temporal facial expressions extracted from video frames with semantic and prosodic features derived from audio transcripts, enabling robust discrimination between truthful and deceptive behavior. Unlike traditional approaches that rely solely on handcrafted features or unimodal inputs, the Mod CNN architecture is optimized for low-latency environments, providing a balance between computational efficiency and predictive performance. The model was trained and evaluated on benchmark deception datasets, generalization demonstrating superior accuracy and compared to existing state-of-the-art techniques. Key design considerations include attention-based feature fusion and adaptive pooling strategies that enhance discriminative power while minimizing over-fitting. The results validate the effectiveness of combining facial micro-expressions with linguistic and paralinguistic signals in deception detection tasks. This study contributes to the growing field of human behavior analysis by offering a practical and scalable solution for real-time deception detection in law enforcement, virtual interviews, and border security applications.

Keywords: Deception Detection; Multi-modal Features; Mod-CNN; Facial Expressions; Audio Transcripts (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://ijsrst.com/home/article/view/IJSRST2512354 Abstract page (text/html)
https://ijsrst.com/home/article/download/IJSRST2512354/IJSRST2512354 Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:etm:ijsrst:v12:y2025:i3:id:857

DOI: 10.32628/IJSRST2512354

Access Statistics for this article

More articles in International Journal of Scientific Research in Science and Technology from Technoscience Academy
Bibliographic data for series maintained by Pankaj Sharma ().