Infrared and Visible Image Fusion Using a State-Space Adversarial Model with Cross-Modal Dependency Learning

Qingqing Hu, Yiran Peng, KinTak U () and Siyuan Zhao ()
Additional contact information
Qingqing Hu: Faculty of Humanities and Arts, Macau University of Science and Technology, Macau 999078, China
Yiran Peng: Faculty of Innovation Engineering, Macau University of Science and Technology, Macau 999078, China
KinTak U: Faculty of Innovation Engineering, Macau University of Science and Technology, Macau 999078, China
Siyuan Zhao: Faculty of Humanities and Arts, Macau University of Science and Technology, Macau 999078, China

Mathematics, 2025, vol. 13, issue 15, 1-22

Abstract: Infrared and visible image fusion plays a critical role in multimodal perception systems, particularly under challenging conditions such as low illumination, occlusion, or complex backgrounds. However, existing approaches often struggle with global feature modelling, cross-modal dependency learning, and preserving structural details in the fused images. In this paper, we propose a novel adversarial fusion framework driven by a state-space modelling paradigm to address these limitations. In the feature extraction phase, a computationally efficient state-space model is utilized to capture global semantic context from both infrared and visible inputs. A cross-modality state-space architecture is then introduced in the fusion phase to model long-range dependencies between heterogeneous features effectively. Finally, a multi-class discriminator, trained under an adversarial learning scheme, enhances the structural fidelity and detail consistency of the fused output. Extensive experiments conducted on publicly available infrared–visible fusion datasets demonstrate that the proposed method achieves superior performance in terms of information retention, contrast enhancement, and visual realism. The results confirm the robustness and generalizability of our framework for complex scene understanding and downstream tasks such as object detection under adverse conditions.

Keywords: image fusion; state-space model; adversarial network; deep learning (search for similar items in EconPapers)
JEL-codes: C (search for similar items in EconPapers)
Date: 2025
References: Add references at CitEc
Citations:

Downloads: (external link)
https://www.mdpi.com/2227-7390/13/15/2333/pdf (application/pdf)
https://www.mdpi.com/2227-7390/13/15/2333/ (text/html)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:gam:jmathe:v:13:y:2025:i:15:p:2333-:d:1707264

Access Statistics for this article

Mathematics is currently edited by Ms. Emma He

More articles in Mathematics from MDPI
Bibliographic data for series maintained by MDPI Indexing Manager ().