A deep multi-modal neural network for informative Twitter content classification during emergencies

Abhinav Kumar (), Jyoti Prakash Singh (), Yogesh K. Dwivedi () and Nripendra P. Rana ()
Additional contact information
Abhinav Kumar: National Institute of Technology Patna
Jyoti Prakash Singh: National Institute of Technology Patna
Yogesh K. Dwivedi: Emerging Markets Research Centre (EMaRC)
Nripendra P. Rana: University of Bradford

Annals of Operations Research, 2022, vol. 319, issue 1, No 25, 822 pages

Abstract: Abstract People start posting tweets containing texts, images, and videos as soon as a disaster hits an area. The analysis of these disaster-related tweet texts, images, and videos can help humanitarian response organizations in better decision-making and prioritizing their tasks. Finding the informative contents which can help in decision making out of the massive volume of Twitter content is a difficult task and require a system to filter out the informative contents. In this paper, we present a multi-modal approach to identify disaster-related informative content from the Twitter streams using text and images together. Our approach is based on long-short-term-memory and VGG-16 networks that show significant improvement in the performance, as evident from the validation result on seven different disaster-related datasets. The range of F1-score varied from 0.74 to 0.93 when tweet texts and images used together, whereas, in the case of only tweet text, it varies from 0.61 to 0.92. From this result, it is evident that the proposed multi-modal system is performing significantly well in identifying disaster-related informative social media contents.

Keywords: Disaster; Twitter; LSTM; VGG-16; Social media; Tweets (search for similar items in EconPapers)
Date: 2022
References: View references in EconPapers View complete reference list from CitEc
Citations:

Downloads: (external link)
http://link.springer.com/10.1007/s10479-020-03514-x Abstract (text/html)
Access to the full text of the articles in this series is restricted.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:annopr:v:319:y:2022:i:1:d:10.1007_s10479-020-03514-x

Ordering information: This journal article can be ordered from
http://www.springer.com/journal/10479

DOI: 10.1007/s10479-020-03514-x

Access Statistics for this article

Annals of Operations Research is currently edited by Endre Boros

More articles in Annals of Operations Research from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().