Most fusion methods tend to prioritize the subjective fusion effect, ignoring follow-up missions like segmentation or detection. Meanwhile, most of the feature extraction structures of fusion methods only use CNN to extract feature of images, which causes inadequate feature extraction thus making the fused images perform badly in follow-up missions. To make above issues addressed, we propose a fusion method via global-local feature extraction and edge-gradient preservation named GLEGNet. The global and local feature extraction module (GLEM) of GLEGNet is proposed to extract both global and local features, so as to refrain from losing key information for the final fusion. The edge and gradient preservation module(EGPM) is used to promote targets in fused images to have clear edges and gradient preservation to facilitate downstream tasks. The experiment results of comparison suggest the method we propose not only performs excellently in qualitative and quantitative comparisons, but also in follow-up missions and generalization experiments.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

GLEGNet: Infrared and Visible Image Fusion via Global-Local Feature Extraction and Edge-Gradient Preservation

  • Guohua Lv,
  • Wenkuo Song,
  • Zhonghe Wei,
  • Aimei Dong,
  • Jinyong Cheng,
  • Guangxiao Ma

摘要

Most fusion methods tend to prioritize the subjective fusion effect, ignoring follow-up missions like segmentation or detection. Meanwhile, most of the feature extraction structures of fusion methods only use CNN to extract feature of images, which causes inadequate feature extraction thus making the fused images perform badly in follow-up missions. To make above issues addressed, we propose a fusion method via global-local feature extraction and edge-gradient preservation named GLEGNet. The global and local feature extraction module (GLEM) of GLEGNet is proposed to extract both global and local features, so as to refrain from losing key information for the final fusion. The edge and gradient preservation module(EGPM) is used to promote targets in fused images to have clear edges and gradient preservation to facilitate downstream tasks. The experiment results of comparison suggest the method we propose not only performs excellently in qualitative and quantitative comparisons, but also in follow-up missions and generalization experiments.