Next Article in Journal
Attention-Based Quantile Regression for RUL Uncertainty Prediction
Previous Article in Journal
Covariant Approach to the Geometric Dilution of Precision
Previous Article in Special Issue
FAMA-DET: A Frequency-Domain Adaptive Multi-Scale Attention Detection Network for Aircraft Target Detection in Optical Remote Sensing Images
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
This is an early access version, the complete PDF, HTML, and XML versions will be available soon.
Article

Adaptive Reliability-Calibrated Consensus–Complementarity–Conflict Modeling for Infrared and Visible Image Fusion

School of Information and Electronics, Beijing Institute of Technology, Beijing 100081, China
*
Author to whom correspondence should be addressed.
Sensors 2026, 26(15), 4745; https://doi.org/10.3390/s26154745 (registering DOI)
Submission received: 17 June 2026 / Revised: 24 July 2026 / Accepted: 24 July 2026 / Published: 26 July 2026
(This article belongs to the Special Issue Remote Sensing Image Fusion and Object Tracking)

Abstract

Infrared and visible image fusion needs to preserve visible texture details and infrared thermal saliency, yet emphasizing one modality may suppress or distort useful information from the other, while cross-modal differences may also contain noise, pseudo-textures, or locally incompatible boundaries. We propose ARC3Fusion, which reformulates image fusion as a reliability-calibrated consensus–complementarity–conflict process to achieve a more effective balance between visible texture detail and infrared target saliency. A progressive shared encoder and a modality-specific residual adapter first produce comparable yet modality-aware features. Cross-Modal Explainable Residual Decomposition then estimates jointly supported consensus and represents the information unexplained by the opposite modality as candidate residuals. Trustworthy Complementarity Verification evaluates infrared residuals using source intensity and edge evidence, while visible residuals are examined using source cues and learnable frequency-pattern evidence. Cross-Modal Conflict Estimation further characterizes local incompatibility through co-activation, reliability, amplitude imbalance, edge-strength mismatch, and orientation mismatch. Conflict-Aware Routing finally coordinates consensus and verified residuals according to these relation cues. Unlike conventional shared–private decomposition that directly preserves private features, ARC3Fusion treats modality-specific residuals as candidates that must be verified and conflict-coordinated before fusion. Experiments on LLVIP, MSRS, and TNO demonstrate consistent fusion performance. On LLVIP, ARC3Fusion achieves the best EN, SF, AG, VIF, and SCD values of 7.158, 14.467, 4.331, 1.136, and 1.229, respectively. These results indicate that verifying modality-specific residuals and coordinating local conflicts improves the joint preservation of visible texture details and infrared thermal saliency.
Keywords: infrared and visible image fusion; multimodal remote sensing; complex-condition perception; trustworthy complementarity verification; conflict-aware routing infrared and visible image fusion; multimodal remote sensing; complex-condition perception; trustworthy complementarity verification; conflict-aware routing

Share and Cite

MDPI and ACS Style

Tian, B.; Luo, J.; Lin, K.; Zhang, C.; Qin, T. Adaptive Reliability-Calibrated Consensus–Complementarity–Conflict Modeling for Infrared and Visible Image Fusion. Sensors 2026, 26, 4745. https://doi.org/10.3390/s26154745

AMA Style

Tian B, Luo J, Lin K, Zhang C, Qin T. Adaptive Reliability-Calibrated Consensus–Complementarity–Conflict Modeling for Infrared and Visible Image Fusion. Sensors. 2026; 26(15):4745. https://doi.org/10.3390/s26154745

Chicago/Turabian Style

Tian, Bowen, Jihao Luo, Ke Lin, Changqing Zhang, and Tong Qin. 2026. "Adaptive Reliability-Calibrated Consensus–Complementarity–Conflict Modeling for Infrared and Visible Image Fusion" Sensors 26, no. 15: 4745. https://doi.org/10.3390/s26154745

APA Style

Tian, B., Luo, J., Lin, K., Zhang, C., & Qin, T. (2026). Adaptive Reliability-Calibrated Consensus–Complementarity–Conflict Modeling for Infrared and Visible Image Fusion. Sensors, 26(15), 4745. https://doi.org/10.3390/s26154745

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop