<p>Existing methods for infrared and visible image fusion (IVIF) effectively highlight thermal targets but often fail to accurately and fully represent scene information, particularly in low-light environments. This limitation stems from two primary reasons: the modality difference between infrared and visible images, which can distort the fused image when introducing single-channel infrared information, and the ignorance of illumination degradation in the visible image, which can make the fused image appear dark and lacking in scene details. To address these challenges, we propose an efficient feature difference-based IVIF method tailored for low-light conditions. Our method jointly processes low-light image enhancement (LLIE) and IVIF. First, the low-light visible image is adaptively enhanced to produce a bright scene with rich textures and colors. Additionally, we map infrared and visible images into a same high-dimensional feature space and present a feature difference mechanism to ensure the fused image contains all visible image information while retaining only infrared image unique information. This avoids the risk of distortion from introducing redundant infrared information. We also propose a three-channel fusion coefficient map and strengthen the correlation between infrared and visible modalities, converting infrared unique information into a three-channel format. This resolves distortion issues from modality differences during fusion, ensuring accurate scene details. To achieve low computational cost and high efficiency during testing, we employ a multi-stage training strategy, enabling a single lightweight module to produce stable fusion results. Extensive experiments demonstrate that our method surpasses state-of-the-art (SOTA) methods in terms of fusion quality and efficiency.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Efficient feature difference-based infrared and visible image fusion for low-light environments

  • Duo Liu,
  • Guoyin Zhang,
  • Yiqi Shi,
  • Ye Tian,
  • Liguo Zhang

摘要

Existing methods for infrared and visible image fusion (IVIF) effectively highlight thermal targets but often fail to accurately and fully represent scene information, particularly in low-light environments. This limitation stems from two primary reasons: the modality difference between infrared and visible images, which can distort the fused image when introducing single-channel infrared information, and the ignorance of illumination degradation in the visible image, which can make the fused image appear dark and lacking in scene details. To address these challenges, we propose an efficient feature difference-based IVIF method tailored for low-light conditions. Our method jointly processes low-light image enhancement (LLIE) and IVIF. First, the low-light visible image is adaptively enhanced to produce a bright scene with rich textures and colors. Additionally, we map infrared and visible images into a same high-dimensional feature space and present a feature difference mechanism to ensure the fused image contains all visible image information while retaining only infrared image unique information. This avoids the risk of distortion from introducing redundant infrared information. We also propose a three-channel fusion coefficient map and strengthen the correlation between infrared and visible modalities, converting infrared unique information into a three-channel format. This resolves distortion issues from modality differences during fusion, ensuring accurate scene details. To achieve low computational cost and high efficiency during testing, we employ a multi-stage training strategy, enabling a single lightweight module to produce stable fusion results. Extensive experiments demonstrate that our method surpasses state-of-the-art (SOTA) methods in terms of fusion quality and efficiency.