A Systematic Literature Review on Multimodal Abstractive Text Summarisation Using Transformer-Based and Attention Models
Tchouya’a Ngoko Israel Christian and
Boniface Kabaso ()
Additional contact information
Tchouya’a Ngoko Israel Christian: Cape Peninsula University of Technology, Department of Information Technology and Design
Boniface Kabaso: Cape Peninsula University of Technology, Department of Information Technology and Design
A chapter in Recent Advances in Information Systems, 2026, pp 681-694 from Springer
Abstract:
Abstract The easy access to technology and the COVID-19 outbreak has accelerated communication among users through various multimedia formats (text, image, audio, and video). This has resulted in the mass production of multimodal information and has created challenges among many users in selecting relevant content, which is deeply buried within vast multimodal data generated. To address this issue, multimodal summarisation has emerged, aiming to enhance user experience by generating representative visual and textual summaries. However, current methods often lack semantic coherence and grammatical accuracy due to the complexity of integrating multiple modalities. This paper conducts a systematic review of multimodal abstractive texts summarisation techniques using PRISMA framework, with a focus on transformed-based models including attention mechanisms. It analyses recent studies, theirs methods, datasets, and performance based on ROUGE metrics. The findings indicate that approaches such as hierarchical attention and BERT-based models improve summarisation quality but still faced challenges including data alignment, computational cost, and limited datasets diversity. ROUGE benchmarking reveals inconsistent results with How2 and Dailymail datasets frequently used. The study highlights the need better modality fusion, improve generalisation and dataset diversity in future research.
Keywords: Multimodal summarisation; Abstractive text summarisation; Transformer-based; DUC; ROUGE scores (search for similar items in EconPapers)
Date: 2026
References: Add references at CitEc
Citations:
There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.
Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.
Export reference: BibTeX
RIS (EndNote, ProCite, RefMan)
HTML/Text
Persistent link: https://EconPapers.repec.org/RePEc:spr:prochp:978-3-032-14099-9_45
Ordering information: This item can be ordered from
http://www.springer.com/9783032140999
DOI: 10.1007/978-3-032-14099-9_45
Access Statistics for this chapter
More chapters in Progress in IS from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().