Generating Image Captions in Hindi Based on Encoder-Decoder Based Deep Learning Techniques

Priya Singh (), Farhan Raja and Hariom Sharma
Additional contact information
Priya Singh: Delhi Technological University
Farhan Raja: Delhi Technological University
Hariom Sharma: Delhi Technological University

A chapter in Reliability Engineering for Industrial Processes, 2024, pp 81-94 from Springer

Abstract: Abstract Image Captioning has experienced significant advancements recently, combining computer vision and natural language processing to create a new field that describes images in words. These approaches utilize an encoder-decoder architecture, where an image is encoded into features by an encoder and those features are decoded into a text sequence by a decoder. Typically, Convolutional Neural Networks (CNNs) are employed as encoders, while Recurrent Neural Networks (RNNs) serve as decoders in these models. Although much of the work in this domain focuses on English, research on Image Captioning models for regional languages is limited. Hindi, being a morphologically rich language and the third most spoken language worldwide, is the focus of this paper. The study conducts a comparative analysis of four state-of-the-art Image Captioning models (ResNet50, InceptionV3, VGG16, and VGG19) specifically applied to the Hindi language. The evaluation of these models’ performance in generating image captions on the widely used Flickr8k dataset employs BLEU, METEOR, and RIBES scores. The results indicate that the InceptionV3 model surpasses the other three models in terms of both BLEU and METEOR scores, making it a valuable reference for researchers operating within this field.

Keywords: Image captioning; VGG16; VGG19; ResNet50; InceptionV3; Hindi captions (search for similar items in EconPapers)
Date: 2024
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:ssrchp:978-3-031-55048-5_6

Ordering information: This item can be ordered from
http://www.springer.com/9783031550485

DOI: 10.1007/978-3-031-55048-5_6

Access Statistics for this chapter

More chapters in Springer Series in Reliability Engineering from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().