Next-LSTM: a novel LSTM-based image captioning technique

Priya Singh (), Chandan Kumar () and Ayush Kumar ()
Additional contact information
Priya Singh: Delhi Technological University
Chandan Kumar: Delhi Technological University
Ayush Kumar: Delhi Technological University

International Journal of System Assurance Engineering and Management, 2023, vol. 14, issue 4, No 25, 1492-1503

Abstract: Abstract Recently, image captioning has evolved into an immensely popular area in the field of Computer Vision. Research in this area is active and various Machine learning-based image captioning models have been proposed in the literature. It strives to generate natural language sentences in order to describe the salient parts of a given image. The main challenge with the existing approaches is effectively extracting image features to generate adequate image captions. Further, there is a need to improve the generalizability of the results on large and diverse datasets. In the current paper, a novel method, namely Next-LSTM is proposed for image captioning. It first extracts the image features using ResNeXt. It is a powerful convolution neural network based model that is adopted for the first time in the image captioning domain. Later, it applies a Long-short term memory network on the extracted features to generate accurate captions for the images. The proposed framework is then evaluated on the benchmark Flickr-8k dataset on Accuracy and BLEU Score. The performance of the proposed framework is also compared to the state-of-the-art approaches, and it outperforms the existing approaches.

Keywords: Computer Vision; Image Captioning; ResNext; Long-Short Term Memory; Convolutional Neural Network; Natural Language Processing (search for similar items in EconPapers)
Date: 2023
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s13198-023-01956-7 Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:ijsaem:v:14:y:2023:i:4:d:10.1007_s13198-023-01956-7

Ordering information: This journal article can be ordered from
http://www.springer.com/engineering/journal/13198

DOI: 10.1007/s13198-023-01956-7

Access Statistics for this article

International Journal of System Assurance Engineering and Management is currently edited by P.K. Kapur, A.K. Verma and U. Kumar

More articles in International Journal of System Assurance Engineering and Management from Springer, The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().