Deterring Deepfake Attacks with an Electrical Network Frequency Fingerprints Approach

Deeraj Nagothu, Ronghua Xu, Yu Chen, Erik Blasch and Alexander Aved
Additional contact information
Deeraj Nagothu: Department of Electrical and Computer Engineering, Binghamton University, Binghamton, NY 13902, USA
Ronghua Xu: Department of Electrical and Computer Engineering, Binghamton University, Binghamton, NY 13902, USA
Yu Chen: Department of Electrical and Computer Engineering, Binghamton University, Binghamton, NY 13902, USA
Erik Blasch: The U.S. Air Force Research Laboratory, Rome, NY 13441, USA
Alexander Aved: The U.S. Air Force Research Laboratory, Rome, NY 13441, USA

Future Internet, 2022, vol. 14, issue 5, 1-20

Abstract: With the fast development of Fifth-/Sixth-Generation (5G/6G) communications and the Internet of Video Things (IoVT), a broad range of mega-scale data applications emerge (e.g., all-weather all-time video). These network-based applications highly depend on reliable, secure, and real-time audio and/or video streams (AVSs), which consequently become a target for attackers. While modern Artificial Intelligence (AI) technology is integrated with many multimedia applications to help enhance its applications, the development of General Adversarial Networks (GANs) also leads to deepfake attacks that enable manipulation of audio or video streams to mimic any targeted person. Deepfake attacks are highly disturbing and can mislead the public, raising further challenges in policy, technology, social, and legal aspects. Instead of engaging in an endless AI arms race “fighting fire with fire”, where new Deep Learning (DL) algorithms keep making fake AVS more realistic, this paper proposes a novel approach that tackles the challenging problem of detecting deepfaked AVS data leveraging Electrical Network Frequency (ENF) signals embedded in the AVS data as a fingerprint. Under low Signal-to-Noise Ratio (SNR) conditions, Short-Time Fourier Transform (STFT) and Multiple Signal Classification (MUSIC) spectrum estimation techniques are investigated to detect the Instantaneous Frequency (IF) of interest. For reliable authentication, we enhanced the ENF signal embedded through an artificial power source in a noisy environment using the spectral combination technique and a Robust Filtering Algorithm (RFA). The proposed signal estimation workflow was deployed on a continuous audio/video input for resilience against frame manipulation attacks. A Singular Spectrum Analysis (SSA) approach was selected to minimize the false positive rate of signal correlations. Extensive experimental analysis for a reliable ENF edge-based estimation in deepfaked multimedia recordings is provided to facilitate the need for distinguishing artificially altered media content.

Keywords: deepfake attacks; Audio and Video Systems (AVS); Internet of Video Things (IoVT); adversarial machine learning; environmental fingerprint; Electrical Network Frequency (ENF) signals; spectral estimation; Singular Spectrum Analysis (SSA) (search for similar items in EconPapers)
JEL-codes: O3 (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1999-5903/14/5/125/pdf (application/pdf)
https://www.mdpi.com/1999-5903/14/5/125/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jftint:v:14:y:2022:i:5:p:125-:d:798538

Access Statistics for this article

Future Internet is currently edited by Ms. Grace You

More articles in Future Internet from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().