Scene degradation-aware fusion network for robust infrared and visible image synthesis in extreme conditions
摘要
Image fusion technology, which integrates information from infrared and visible light sensors, is crucial for enhancing environmental perception in autonomous systems. However, most existing image fusion methods primarily emphasize intricate feature extraction and complex fusion strategies. As a result, they often fail to account for scene degradation, which severely impairs fusion quality in extreme environments. To address this problem, we propose SDCFuse, an infrared-visible image fusion network equipped with a scene degradation correction function. The network integrates a vision-language-based degradation discriminator for accurate identification of degradation types and a prior-guided correction mechanism to adaptively restore image quality. It effectively compensates for various forms of scene degradation, including haze, low light, and overexposure, thereby enhancing model performance under extreme conditions. Experimental results on four datasets demonstrate SDCFuse’s superior performance in correcting severe degradation, achieving state-of-the-art results with improvements of up to 25% in average gradient and 30% in entropy compared to existing methods. The source code and details are available at https://github.com/kayla0must/Image_Fusion_SDCFusion.