Image fusion aims to effectively integrate complementary information from multi-modal images into a single image with enhanced representational capacity. However, simultaneously preserving structural semantics and texture details during the fusion process remains a significant challenge. To address this, we propose an innovative fusion framework based on frequency-domain decomposition and implicit space modeling, termed KMMF-Net. This method employs a lightweight Mamba network as the backbone to extract discriminative features from the input images. Subsequently, the extracted features are decomposed into high-frequency and low-frequency components using the Fast Fourier Transform (FFT). In the low-frequency branch, we introduce a KAN-based implicit space fusion strategy to project structural features from different modalities into a unified implicit space for alignment and integration. To further enhance structural consistency, a low-frequency enhancement module is designed to refine these features. In the high-frequency branch, a dedicated high-frequency enhancement module is constructed to reinforce texture and edge information, thereby better preserving fine details. Finally, the fused high- and low-frequency features are reconstructed into the final output image. Extensive experiments on infrared-visible and medical image fusion tasks demonstrate that KMMF-Net achieves state-of-the-art performance in both visual quality and objective metrics. This method offers a unified and interpretable solution for frequency-domain image fusion tasks. The code is available at https://github.com/fengjiawei123/KMMF-Net .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

KMMF-Net: Implicit Fusion with KAN-Guided Mamba Modeling

  • Jiawei Feng,
  • Haiyu Song,
  • Yun Mao,
  • Jiayu Wang,
  • Mingyu Ge,
  • Zhengchi Du,
  • Jialiang Chen,
  • Zeyu Wang

摘要

Image fusion aims to effectively integrate complementary information from multi-modal images into a single image with enhanced representational capacity. However, simultaneously preserving structural semantics and texture details during the fusion process remains a significant challenge. To address this, we propose an innovative fusion framework based on frequency-domain decomposition and implicit space modeling, termed KMMF-Net. This method employs a lightweight Mamba network as the backbone to extract discriminative features from the input images. Subsequently, the extracted features are decomposed into high-frequency and low-frequency components using the Fast Fourier Transform (FFT). In the low-frequency branch, we introduce a KAN-based implicit space fusion strategy to project structural features from different modalities into a unified implicit space for alignment and integration. To further enhance structural consistency, a low-frequency enhancement module is designed to refine these features. In the high-frequency branch, a dedicated high-frequency enhancement module is constructed to reinforce texture and edge information, thereby better preserving fine details. Finally, the fused high- and low-frequency features are reconstructed into the final output image. Extensive experiments on infrared-visible and medical image fusion tasks demonstrate that KMMF-Net achieves state-of-the-art performance in both visual quality and objective metrics. This method offers a unified and interpretable solution for frequency-domain image fusion tasks. The code is available at https://github.com/fengjiawei123/KMMF-Net .