Previous Article in Journal
A Review of Zero Trust Architecture: Principles, Applications, and Implementation Challenges in Communication, Navigation, and Surveillance (CNS) Systems
Previous Article in Special Issue
RGB-D Mirror Segmentation with Reliability-Guided Residual Correction
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
This is an early access version, the complete PDF, HTML, and XML versions will be available soon.
Article

A Dual-Branch Lightweight Network for Multimodal Image Fusion with Mamba and INN

by
Nan Li
1,2,
Hongxin Li
1,2 and
Lin Tian
1,2,*
1
Xinjiang Laboratory of Phase Transitions and Microstructures in Condensed Matter Physics, Yili Normal University, Yining 835000, China
2
School of Electronic Engineering, Yili Normal University, Yining 835000, China
*
Author to whom correspondence should be addressed.
Sensors 2026, 26(12), 3814; https://doi.org/10.3390/s26123814 (registering DOI)
Submission received: 11 May 2026 / Revised: 7 June 2026 / Accepted: 12 June 2026 / Published: 15 June 2026

Abstract

Multimodal image fusion aims to integrate complementary information from heterogeneous imaging modalities into a single informative image. However, many deep learning-based fusion methods rely on complex feature extractors, leading to high computational cost and limited suitability for real-time deployment on resource-constrained devices. To address this issue, this paper proposes a lightweight Mamba-INN dual-branch network for efficient multimodal image fusion. The proposed model decouples global structure modeling from local detail preservation. A simplified Mamba-inspired branch is designed to capture long-range contextual dependencies, while a lightweight invertible neural network branch preserves high-frequency textures and edge information through information-preserving transformations. The lightweight INN branch preserves high-frequency texture and edge information during the forward feature transformation process through reversible feature partitioning, coupled transformations, and exponential scale modulation, thereby reducing the loss of detail caused by feature compression. Compact shallow feature refinement, module reuse, low-dimensional channel design, and a streamlined decoder are further introduced to reduce redundant computation. Experiments on infrared-visible and medical image fusion benchmarks, including MSRS, TNO, RoadScene, MRI-CT, MRI-PET, and MRI-SPECT datasets, demonstrate that the proposed method achieves competitive fusion quality with low model complexity. The proposed method achieves performance comparable to or better than that of methods such as CDDFuse, U2Fusion, CNN and SDNet on metrics including MI, VIF, Qabf, and SSIM for infrared-visible and medical image fusion tasks, while containing only 0.24 million parameters and requiring 24.04 GFLOPs of computational power at an input resolution of 256 × 256. Compared to CDDFuse, our method significantly reduces model complexity, enhancing the potential for lightweight deployment while maintaining fusion quality.
Keywords: multimodal image fusion; lightweight network; Mamba; invertible neural network; infrared-visible image fusion; medical image fusion multimodal image fusion; lightweight network; Mamba; invertible neural network; infrared-visible image fusion; medical image fusion

Share and Cite

MDPI and ACS Style

Li, N.; Li, H.; Tian, L. A Dual-Branch Lightweight Network for Multimodal Image Fusion with Mamba and INN. Sensors 2026, 26, 3814. https://doi.org/10.3390/s26123814

AMA Style

Li N, Li H, Tian L. A Dual-Branch Lightweight Network for Multimodal Image Fusion with Mamba and INN. Sensors. 2026; 26(12):3814. https://doi.org/10.3390/s26123814

Chicago/Turabian Style

Li, Nan, Hongxin Li, and Lin Tian. 2026. "A Dual-Branch Lightweight Network for Multimodal Image Fusion with Mamba and INN" Sensors 26, no. 12: 3814. https://doi.org/10.3390/s26123814

APA Style

Li, N., Li, H., & Tian, L. (2026). A Dual-Branch Lightweight Network for Multimodal Image Fusion with Mamba and INN. Sensors, 26(12), 3814. https://doi.org/10.3390/s26123814

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Article metric data becomes available approximately 24 hours after publication online.
Back to TopTop