Frequency Domain Filtered Residual Network for Deepfake Detection

Bo Wang, Xiaohan Wu, Yeling Tang, Yanyan Ma, Zihao Shan and Fei Wei ()
Additional contact information
Bo Wang: School of Information and Communication Engineering, Dalian University of Technology, Dalian 116024, China
Xiaohan Wu: School of Information and Communication Engineering, Dalian University of Technology, Dalian 116024, China
Yeling Tang: School of Information and Communication Engineering, Dalian University of Technology, Dalian 116024, China
Yanyan Ma: School of Information and Communication Engineering, Dalian University of Technology, Dalian 116024, China
Zihao Shan: Independent Researcher, 1 Hacker Way, Menlo Park, CA 94560, USA
Fei Wei: School of Computing, National University of Singapore, 13 Computing Drive, Singapore 117417, Singapore

Mathematics, 2023, vol. 11, issue 4, 1-13

Abstract: As deepfake becomes more sophisticated, the demand for fake facial image detection is increasing. Although great progress has been made in deepfake detection, the performance of most existing deepfake detection methods degrade significantly when these methods are applied to detect low-quality images for the disappearance of key clues during the compression process. In this work, we mine frequency domain and RGB domain information to specifically improve the detection of low-quality compressed deepfake images. Our method consists of two modules: (1) a preprocessing module and (2) a classification module. In the preprocessing module, we utilize the Haar wavelet transform and residual calculation to obtain the mid-high frequency joint information and fuse the frequency map with the RGB input. In the classification module, the image obtained by concatenation is fed to the convolutional neural network for classification. Because of the combination of RGB and frequency domain, the robustness of the model has been greatly improved. Our extensive experimental results demonstrate that our approach can not only achieve excellent performance when detecting low-quality compressed deepfake images, but also maintain great performance with high-quality images.

Keywords: deepfake detection; neural networks; wavelet transform; frequency domain features; feature fusion (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://www.mdpi.com/2227-7390/11/4/816/pdf (application/pdf)
https://www.mdpi.com/2227-7390/11/4/816/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:11:y:2023:i:4:p:816-:d:1059086

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().