Privacy-Preserving Image Captioning with Deep Learning and Double Random Phase Encoding

Antoinette Deborah Martin, Ezat Ahmadzadeh and Inkyu Moon ()
Additional contact information
Antoinette Deborah Martin: Department of Robotics and Mechatronics Engineering, Daegu Gyeongbuk Institute of Science and Technology (DGIST), Hyeonpung-myeon, Dalseong-gun, Daegu 42988, Korea
Ezat Ahmadzadeh: Department of Robotics and Mechatronics Engineering, Daegu Gyeongbuk Institute of Science and Technology (DGIST), Hyeonpung-myeon, Dalseong-gun, Daegu 42988, Korea
Inkyu Moon: Department of Robotics and Mechatronics Engineering, Daegu Gyeongbuk Institute of Science and Technology (DGIST), Hyeonpung-myeon, Dalseong-gun, Daegu 42988, Korea

Mathematics, 2022, vol. 10, issue 16, 1-14

Abstract: Cloud storage has become eminent, with an increasing amount of data being produced daily; this has led to substantial concerns related to privacy and unauthorized access. To secure privacy, users can protect their private data by uploading encrypted data to the cloud. Data encryption allows computations to be performed on encrypted data without the data being decrypted in the cloud, which requires enormous computation resources and prevents unauthorized access to private data. Data analysis such as classification, and image query and retrieval can preserve data privacy if the analysis is performed using encrypted data. This paper proposes an image-captioning method that generates captions over encrypted images using an encoder–decoder framework with attention and a double random phase encoding (DRPE) encryption scheme. The images are encrypted with DRPE to protect them and then fed to an encoder that adopts the ResNet architectures to generate a fixed-length vector of representations or features. The decoder is designed with long short-term memory to process the features and embeddings to generate descriptive captions for the images. We evaluate the predicted captions with BLEU, METEOR, ROUGE, and CIDEr metrics. The experimental results demonstrate the feasibility of our privacy-preserving image captioning on the popular benchmark Flickr8k dataset.

Keywords: image captioning; deep learning; privacy preserving; double random phase encoding; deep neural networks (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
https://www.mdpi.com/2227-7390/10/16/2859/pdf (application/pdf)
https://www.mdpi.com/2227-7390/10/16/2859/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:10:y:2022:i:16:p:2859-:d:885422

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().