Semantic segmentation of imagery is critical for remote sensing feature extraction and image generation, but faces challenges like microscopic structure recognition in high-resolution images and ambiguous semantic boundaries in complex scenes—leading to suboptimal precision, detail loss, and insufficient frequency-spatial feature integration. To address these, we propose a multiscale spatio-temporal boundary-aware semantic segmentation framework inspired by biological neural responses, consisting of three core modules: dual-path feature extraction (using spiking convolution kernels, DCT multi-band enhancement, and cross-domain RGB concatenation for info complementarity), multi-scale feature pyramid fusion (via bidirectional cross-scale interaction to integrate high-level semantics and low-level details), and boundary perception (three-stage architecture to extract edge heatmaps and reinforce weak boundaries). Experiments on WHU Satellite Datasets I/II and Qinqiang Dataset show superior performance over existing methods, effectively capturing boundary details in dense built-up and small-target regions while mitigating the “coarse shape” issue.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Boundary-Aware Multi-scale Spiking Neural Network for Image Semantic Segmentation

  • Yumo Li,
  • Sunan Ge,
  • Xueqing Zhao,
  • Xin Shi

摘要

Semantic segmentation of imagery is critical for remote sensing feature extraction and image generation, but faces challenges like microscopic structure recognition in high-resolution images and ambiguous semantic boundaries in complex scenes—leading to suboptimal precision, detail loss, and insufficient frequency-spatial feature integration. To address these, we propose a multiscale spatio-temporal boundary-aware semantic segmentation framework inspired by biological neural responses, consisting of three core modules: dual-path feature extraction (using spiking convolution kernels, DCT multi-band enhancement, and cross-domain RGB concatenation for info complementarity), multi-scale feature pyramid fusion (via bidirectional cross-scale interaction to integrate high-level semantics and low-level details), and boundary perception (three-stage architecture to extract edge heatmaps and reinforce weak boundaries). Experiments on WHU Satellite Datasets I/II and Qinqiang Dataset show superior performance over existing methods, effectively capturing boundary details in dense built-up and small-target regions while mitigating the “coarse shape” issue.