ISCG: An Intelligent Sensing and Caption Generation System for Object Detection and Captioning Using Deep Learning

Aahan Singh, Nithin Nagaraj, Srinidhi Hiriyannaiah and Lalit Mohan Patnaik
Additional contact information
Aahan Singh: Ramaiah Institute of Technology, India
Nithin Nagaraj: Consciousness Studies Programme, National Institute of Advanced Studies, India
Srinidhi Hiriyannaiah: Ramaiah Institute of Technology, India
Lalit Mohan Patnaik: Consciousness Studies Programme, National Institute of Advanced Studies, Bangalore, India

International Journal of Intelligent Information Technologies (IJIIT), 2020, vol. 16, issue 4, 51-67

Abstract: Artificial intelligence has paved the way for different areas of computing such as speech recognition and translation, object detection, machine translation, and others. One of the goals of artificial general intelligence is to simulate human thinking and rationality within machines such that they are able to perceive their environment and then perform reasonable actions based on their perception. Creating a single model that performs every single task from visual perception to actuation is currently impossible. The system must be divided into several models each of which functions independently as well also contribute to the operation of the whole intelligent machine. In this paper, an intelligent sensing and caption generation (ISCG) system is proposed which is capable of detecting living/non-living objects and states of motion in images. The system consists of two separate modules of caption generator and intelligence engine with a Convolutional Neural Network (CNN) for determining the different objects in the images. Our model yields state-of-the-art performance on benchmarked dataset.

Date: 2020
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 018/IJIIT.2020100104 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jiit00:v:16:y:2020:i:4:p:51-67

Access Statistics for this article

International Journal of Intelligent Information Technologies (IJIIT) is currently edited by Vijayan Sugumaran

More articles in International Journal of Intelligent Information Technologies (IJIIT) from IGI Global
Bibliographic data for series maintained by Journal Editor ().