A Comparative Analysis of Compression and Transfer Learning Techniques in DeepFake Detection Models

Andreas Karathanasis, John Violos () and Ioannis Kompatsiaris
Additional contact information
Andreas Karathanasis: Information Technologies Institute, Centre for Research & Technology, Hellas, 57001 Thessaloniki, Greece
John Violos: Information Technologies Institute, Centre for Research & Technology, Hellas, 57001 Thessaloniki, Greece
Ioannis Kompatsiaris: Information Technologies Institute, Centre for Research & Technology, Hellas, 57001 Thessaloniki, Greece

Mathematics, 2025, vol. 13, issue 5, 1-30

Abstract: DeepFake detection models play a crucial role in ambient intelligence and smart environments, where systems rely on authentic information for accurate decisions. These environments, integrating interconnected IoT devices and AI-driven systems, face significant threats from DeepFakes, potentially leading to compromised trust, erroneous decisions, and security breaches. To mitigate these risks, neural-network-based DeepFake detection models have been developed. However, their substantial computational requirements and long training times hinder deployment on resource-constrained edge devices. This paper investigates compression and transfer learning techniques to reduce the computational demands of training and deploying DeepFake detection models, while preserving performance. Pruning, knowledge distillation, quantization, and adapter modules are explored to enable efficient real-time DeepFake detection. An evaluation was conducted on four benchmark datasets: “SynthBuster”, “140k Real and Fake Faces”, “DeepFake and Real Images”, and “ForenSynths”. It compared compressed models with uncompressed baselines using widely recognized metrics such as accuracy, precision, recall, F1-score, model size, and training time. The results showed that a compressed model at 10% of the original size retained only 56% of the baseline accuracy, but fine-tuning in similar scenarios increased this to nearly 98%. In some cases, the accuracy even surpassed the original’s performance by up to 12%. These findings highlight the feasibility of deploying DeepFake detection models in edge computing scenarios.

Keywords: ambient intelligence; smart environments; deepfake models; compression; transfer learning; edge computing (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2025
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/13/5/887/pdf (application/pdf)
https://www.mdpi.com/2227-7390/13/5/887/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:13:y:2025:i:5:p:887-:d:1606987

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().