Multimodal Information Fusion for Semantic Video Analysis

Elvan Gulen, Turgay Yilmaz and Adnan Yazici
Additional contact information
Elvan Gulen: Department of Computer Engineering, Middle East Technical University, Ankara, Turkey
Turgay Yilmaz: Department of Computer Engineering, Middle East Technical University, Ankara, Turkey and Institute of Industrial Science, University of Tokyo, Tokyo, Japan
Adnan Yazici: Department of Computer Engineering, Middle East Technical University, Ankara, Turkey

International Journal of Multimedia Data Engineering and Management (IJMDEM), 2012, vol. 3, issue 4, 52-74

Abstract: Multimedia data by its very nature contains multimodal information in it. For a successful analysis of multimedia content, all available multimodal information should be utilized. Additionally, since concepts can contain valuable cues about other concepts, concept interaction is a crucial source of multimedia information and helps to increase the fusion performance. The aim of this study is to show that integrating existing modalities along with the concept interactions can yield a better performance in detecting semantic concepts. Therefore, in this paper, the authors present a multimodal fusion approach that integrates semantic information obtained from various modalities along with additional semantic cues. The experiments conducted on TRECVID 2007 and CCV Database datasets validates the superiority of such combination over best single modality and alternative modality combinations. The results show that the proposed fusion approach provides 16.7% relative performance gain on TRECVID dataset and 47.7% relative performance improvement on CCV database over the results of best unimodal approaches.

Date: 2012
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 018/jmdem.2012100103 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jmdem0:v:3:y:2012:i:4:p:52-74

Access Statistics for this article

International Journal of Multimedia Data Engineering and Management (IJMDEM) is currently edited by Chengcui Zhang

More articles in International Journal of Multimedia Data Engineering and Management (IJMDEM) from IGI Global
Bibliographic data for series maintained by Journal Editor ().