From Alt-text to Real Context: Revolutionizing image captioning using the potential of LLM

Vrajkumar Patel, Aayush Modi, Harsh Mistry, Abhishesh Mishra, Rocky Upadhyay and Apoorva Shah

International Journal of Scientific Research in Computer Science, Engineering and Information Technology, 2025, vol. 11, issue 1, 379-387

Abstract: The "From Alt-Text to Real Context" project harnesses the transformative capability of Meta Llama-3.2-11B-Vision-Instruct, thus unleashing an unprecedented image captioning system with advanced multimodal reasoning and attention mechanisms. These descriptions are richly contextual and domain-adaptive, moving them beyond the boundaries of traditional models. The platform has been constructed very carefully, keeping a heavy robust backend in Python (Flask/FastAPI) and an interactive frontend created in React.js for easier human interaction. With strong, advanced tools that include Hugging Face Transformers, OpenCV, NumPy, and Pandas, it shines for fine-tuning models, image preprocessing, and manipulation for particular, domain-specific customizations suited for a wide variety of applications from accessibility to e-commerce and education. The system generates alt-text and can perform complex image analysis and identify key features, providing more comprehensive scene descriptions. It is equipped with sentiment analysis to decipher emotive signals; it can provide critical metrics to quantify positive sentiment. This sophisticated AI system is built on the power of LLM outshines with zero-shot and multilingual capabilities and can also be utilized in tasks like image-based captioning and storytelling. Combining state-of-the-art AI, high adaptability, and great user-friendliness, this project raises new standards for contextual understanding, applicability in real-life scenarios, and image captioning.

Keywords: Meta Llama-3.2; Image captioning; Contextual descriptions; Hugging Face Transformers; Image analysis; Sentiment analysis; Zero-shot capabilities; Large Language Models (search for similar items in EconPapers)
Date: 2025
Note: Article URL: https://ijsrcseit.com/home/article/view/CSEIT25111238
References: Add references at CitEc
Citations:

Downloads: (external link)
https://ijsrcseit.com/home/article/view/CSEIT25111238 Article URL (text/html)
https://ijsrcseit.com/home/article/download/CSEIT25111238/CSEIT25111238 Full text (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:jbh:ijsrcs:v11:y2025:i1:id:690

DOI: 10.32628/CSEIT25111238

Access Statistics for this article

More articles in International Journal of Scientific Research in Computer Science, Engineering and Information Technology from International Journal of Scientific Research in Computer Science, Engineering and Information Technology
Bibliographic data for series maintained by Pankaj Sharma (USA) ().