iCaps-Dfake: An Integrated Capsule-Based Model for Deepfake Image and Video Detection

Samar Samir Khalil, Sherin M. Youssef and Sherine Nagy Saleh
Additional contact information
Samar Samir Khalil: Computer Engineering Department, College of Engineering and Technology Arab Academy for Science, Technology and Maritime Transport, Alexandria 1029, Egypt
Sherin M. Youssef: Computer Engineering Department, College of Engineering and Technology Arab Academy for Science, Technology and Maritime Transport, Alexandria 1029, Egypt
Sherine Nagy Saleh: Computer Engineering Department, College of Engineering and Technology Arab Academy for Science, Technology and Maritime Transport, Alexandria 1029, Egypt

Future Internet, 2021, vol. 13, issue 4, 1-19

Abstract: Fake media is spreading like wildfire all over the internet as a result of the great advancement in deepfake creation tools and the huge interest researchers and corporations are showing to explore its limits. Now anyone can create manipulated unethical media forensics, defame, humiliate others or even scam them out of their money with a click of a button. In this research a new deepfake detection approach, iCaps-Dfake, is proposed that competes with state-of-the-art techniques of deepfake video detection and addresses their low generalization problem. Two feature extraction methods are combined, texture-based Local Binary Patterns (LBP) and Convolutional Neural Networks (CNN) based modified High-Resolution Network (HRNet), along with an application of capsule neural networks (CapsNets) implementing a concurrent routing technique. Experiments have been conducted on large benchmark datasets to evaluate the performance of the proposed model. Several performance metrics are applied and experimental results are analyzed. The proposed model was primarily trained and tested on the DeepFakeDetectionChallenge-Preview (DFDC-P) dataset then tested on Celeb-DF to examine its generalization capability. Experiments achieved an Area-Under Curve (AUC) score improvement of 20.25% over state-of-the-art models.

Keywords: deepfake detection; capsule network; CapsNet; media forensics; HRNet; CNN; LBP; deep learning (search for similar items in EconPapers)
JEL-codes: O3 (search for similar items in EconPapers)
Date: 2021
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1999-5903/13/4/93/pdf (application/pdf)
https://www.mdpi.com/1999-5903/13/4/93/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jftint:v:13:y:2021:i:4:p:93-:d:530509

Access Statistics for this article

Future Internet is currently edited by Ms. Grace You

More articles in Future Internet from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().