EconPapers    
Economics at your fingertips  
 

Detection of Forged Images Using a Combination of Passive Methods Based on Neural Networks

Ancilon Leuch Alencar, Marcelo Dornbusch Lopes, Anita Maria da Rocha Fernandes (), Julio Cesar Santos dos Anjos, Juan Francisco De Paz Santana and Valderi Reis Quietinho Leithardt
Additional contact information
Ancilon Leuch Alencar: Master Program in Applied Computer Science (MCA), Escola Politécnica, University of Vale do Itajaí (UNIVALI), Campus Itajaí, Itajaí 88302-901, Santa Catarina, Brazil
Marcelo Dornbusch Lopes: Master Program in Applied Computer Science (MCA), Escola Politécnica, University of Vale do Itajaí (UNIVALI), Campus Itajaí, Itajaí 88302-901, Santa Catarina, Brazil
Anita Maria da Rocha Fernandes: Master Program in Applied Computer Science (MCA), Escola Politécnica, University of Vale do Itajaí (UNIVALI), Campus Itajaí, Itajaí 88302-901, Santa Catarina, Brazil
Julio Cesar Santos dos Anjos: Graduate Program in Teleinformatics Engineering (PPGETI/UFC), Federal University of Ceará, Campus of Itapaje, Fortaleza 60455-970, Ceará, Brazil
Juan Francisco De Paz Santana: Expert Systems and Applications Laboartory, Escuela Técnica Superior de Ingeniería Industrial de Béjar, University of Salamanca, 37700 Salamanca, Spain
Valderi Reis Quietinho Leithardt: Lisbon School of Engineering (ISEL), Polytechnic University of Lisbon (IPL), 1549-020 Lisbon, Portugal

Future Internet, 2024, vol. 16, issue 3, 1-20

Abstract: In the current era of social media, the proliferation of images sourced from unreliable origins underscores the pressing need for robust methods to detect forged content, particularly amidst the rapid evolution of image manipulation technologies. Existing literature delineates two primary approaches to image manipulation detection: active and passive. Active techniques intervene preemptively, embedding structures into images to facilitate subsequent authenticity verification, whereas passive methods analyze image content for traces of manipulation. This study presents a novel solution to image manipulation detection by leveraging a multi-stream neural network architecture. Our approach harnesses three convolutional neural networks (CNNs) operating on distinct data streams extracted from the original image. We have developed a solution based on two passive detection methodologies. The system utilizes two separate streams to extract specific data subsets, while a third stream processes the unaltered image. Each net independently processes its respective data stream, capturing diverse facets of the image. The outputs from these nets are then fused through concatenation to ascertain whether the image has undergone manipulation, yielding a comprehensive detection framework surpassing the efficacy of its constituent methods. Our work introduces a unique dataset derived from the fusion of four publicly available datasets, featuring organically manipulated images that closely resemble real-world scenarios. This dataset offers a more authentic representation than other state-of-the-art methods that use algorithmically generated datasets based on image patches. By encompassing genuine manipulation scenarios, our dataset enhances the model’s ability to generalize across varied manipulation techniques, thereby improving its performance in real-world settings. After training, the merged approach obtained an accuracy of 89.59% in the set of validation images, significantly higher than the model trained with only unaltered images, which obtained 78.64%, and the two other models trained using images with a feature selection method applied to enhance inconsistencies that obtained 68.02% for Error-Level Analysis images and 50.70% for the method using Discrete Wavelet Transform. Moreover, our proposed approach exhibits reduced accuracy variance compared to alternative models, underscoring its stability and robustness across diverse datasets. The approach outlined in this work needs to provide information about the specific location or type of tempering, which limits its practical applications.

Keywords: digital image forensics; convolutional neural network; deep learning (search for similar items in EconPapers)
JEL-codes: O3 (search for similar items in EconPapers)
Date: 2024
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/1999-5903/16/3/97/pdf (application/pdf)
https://www.mdpi.com/1999-5903/16/3/97/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jftint:v:16:y:2024:i:3:p:97-:d:1356970

Access Statistics for this article

Future Internet is currently edited by Ms. Grace You

More articles in Future Internet from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().

 
Page updated 2025-03-19
Handle: RePEc:gam:jftint:v:16:y:2024:i:3:p:97-:d:1356970