Novel Hybrid Optimization Techniques for Enhanced Generalization and Faster Convergence in Deep Learning Models: The NestYogi Approach to Facial Biometrics

Raoof Altaher () and Hakan Koyuncu
Additional contact information
Raoof Altaher: Electrical and Computer Engineering Department, Altinbas University, Istanbul 34217, Turkey
Hakan Koyuncu: Computer Engineering Department, Altinbas University, Istanbul 34217, Turkey

Mathematics, 2024, vol. 12, issue 18, 1-23

Abstract: In the rapidly evolving field of biometric authentication, deep learning has become a cornerstone technology for face detection and recognition tasks. However, traditional optimizers often struggle with challenges such as overfitting, slow convergence, and limited generalization across diverse datasets. To address these issues, this paper introduces NestYogi, a novel hybrid optimization algorithm that integrates the adaptive learning capabilities of the Yogi optimizer, anticipatory updates of Nesterov momentum, and the generalization power of stochastic weight averaging (SWA). This combination significantly improves both the convergence rate and overall accuracy of deep neural networks, even when trained from scratch. Extensive data augmentation techniques, including noise and blur, were employed to ensure the robustness of the model across diverse conditions. NestYogi was rigorously evaluated on two benchmark datasets Labeled Faces in the Wild (LFW) and YouTube Faces (YTF), demonstrating superior performance with a detection accuracy reaching 98% and a recognition accuracy up to 98.6%, outperforming existing optimization strategies. These results emphasize NestYogi’s potential to overcome critical challenges in face detection and recognition, offering a robust solution for achieving state-of-the-art performance in real-world applications.

Keywords: face detection; face recognition; Yogi algorithm; Nesterov momentum; stochastic weight averaging (SWA); triplet loss; biometric authentication (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/12/18/2919/pdf (application/pdf)
https://www.mdpi.com/2227-7390/12/18/2919/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:12:y:2024:i:18:p:2919-:d:1481570

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().