Can Data Fusion Increase the Performance of Action Detection in the Dark?

Anwaar Ulhaq ()
Additional contact information
Anwaar Ulhaq: Charles Sturt University, School of Computing and Mathematics

Chapter Chapter 12 in Statistics for Data Science and Policy Analysis, 2020, pp 159-171 from Springer

Abstract: Abstract Automated human action detection and recognition is a challenging research problem due to the complexity of its data. Contextual data provides additional cues about the actions like if we know car and man, we can short-list actions involving car and man, i.e., driving, opening the car door etc. Therefore, such data can play a pivotal role in modelling and recognizing human actions. However, the visual context during night is often badly disrupted due to clutter and adverse lighting conditions especially in outdoor environments. This situation requires the visual contextual data fusion of captured video sequences. In this paper, we have explored the significance of contextual data fusion for automated human action recognition in video sequences captured at night-time. For this purpose, we have proposed an action recognition framework based on contextual data fusion, spatio-temporal feature fusion and correlation filtering. We have performed experimentation on multi-sensor night vision video streams from infra-red (IR) and visible (VIS) sensors. Experimental results show that contextual data fusion based on the fused contextual information and its colourization significantly enhances the performance of automated action recognition.

Keywords: Data fusion; Action detection; Night vision (search for similar items in EconPapers)
Date: 2020
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-981-15-1735-8_12

Ordering information: This item can be ordered from
http://www.springer.com/9789811517358

DOI: 10.1007/978-981-15-1735-8_12

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().