Real-Time Multimodal Threat Detection Using Fused Face Recognition, Gait Analysis, and Micro-Expression Classification

Swasti Bajpai, Tanishka Raj Yadav, Yashaswi Saxena, Sneha Hayaran and Rashmi Pandey

International Journal of Scientific Research in Computer Science, Engineering and Information Technology, 2026, vol. 12, issue 3, 284-293

Abstract: The current paper outlines a live video surveillance solution based on the combination of face identity, gait patterns, and micro-expressions for estimation of a security threat level. Instead of basing on one input signal only, the proposed framework incorporates biometrics and behavior metrics so as to make the assessment of the degree of a threat more resilient against various changes in body posture, partial occlusions, or delays in inferring the identity. The paper suggests using three pre-trained ResNet-18 models for identification of faces, analyzing gait patterns, and assessing emotions. The outputs of the three models are combined via the use of a simple, yet effective score-level fusion algorithm. In order to make sure that the system is able to work in real-time conditions, its architecture features asynchronous worker threads, IoU-based tracking approach, and a temporal vote-based filter for stabilization of user identities. In implementation, the solution exhibited rapid locking of identities of enrolled users, swift detection of suspicious unknown identities, and consistent performance of around 18-22 FPS on the GPU-enabled setup.

Keywords: multimodal threat detection; face recognition; gait analysis; micro-expression classification; ResNet-18; score-level fusion; real-time surveillance; IoU tracking (search for similar items in EconPapers)
Date: 2026
Note: Article URL: https://ijsrcseit.com/home/article/view/CSEIT2612339
References: Add references at CitEc
Citations:

Downloads: (external link)
https://ijsrcseit.com/home/article/view/CSEIT2612339 Article URL (text/html)
https://ijsrcseit.com/home/article/download/CSEIT2612339/CSEIT2612339 Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:jbh:ijsrcs:v12:y2026:i3:id:2019

DOI: 10.32628/CSEIT2612339

Access Statistics for this article

More articles in International Journal of Scientific Research in Computer Science, Engineering and Information Technology from International Journal of Scientific Research in Computer Science, Engineering and Information Technology
Bibliographic data for series maintained by Pankaj Sharma ().