<p>The existing semantic segmentation models generally only use local features to segment the target, and the boundary is unclear due to the loss of pixel-level information in multi-class segmentation tasks, thus reducing the network’s performance. Given the above problems, this paper proposes a semantic segmentation network with dual-path decoding and cascaded multi-level feature interaction(DPD-CMFINet). Firstly, the proposed dual-path decoding structure fully fuses deep semantic features and shallow boundary details through feature fusion and multi-stage upsampling strategy, thereby improving the pixel-level information loss caused by long-distance skip connections. Secondly, the proposed Cascaded multi-level feature interaction module (CMLFIM) makes up for the semantic differences in the feature coding process by utilizing step-by-step feature aggregation and interaction. In addition, to capture multi-scale features from different semantic depths, we construct a hierarchical multi-scale attention module (HMSAM) to enable the network to obtain global context more effectively. Finally, we design a multi-resolution semantic fusion module (MRSFM) to fuse high-resolution features and low-resolution features to obtain more accurate segmentation images. We conducted experiments on multiple datasets to verify the segmentation performance of the proposed model. The segmentation accuracy and mIoU (mean Intersection over Union) of the model on the CamVid (The Cambridge-driving Labeled Video Database) dataset were 93.94% and 80.53%, respectively, demonstrating our proposed approach’s usefulness.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A semantic segmentation network with dual-path decoding and cascaded multi-level feature interaction

  • Huaping Zhou,
  • Bin Deng,
  • Kelei Sun,
  • Yongqi Zhang,
  • Tao Wu,
  • Jin Wu

摘要

The existing semantic segmentation models generally only use local features to segment the target, and the boundary is unclear due to the loss of pixel-level information in multi-class segmentation tasks, thus reducing the network’s performance. Given the above problems, this paper proposes a semantic segmentation network with dual-path decoding and cascaded multi-level feature interaction(DPD-CMFINet). Firstly, the proposed dual-path decoding structure fully fuses deep semantic features and shallow boundary details through feature fusion and multi-stage upsampling strategy, thereby improving the pixel-level information loss caused by long-distance skip connections. Secondly, the proposed Cascaded multi-level feature interaction module (CMLFIM) makes up for the semantic differences in the feature coding process by utilizing step-by-step feature aggregation and interaction. In addition, to capture multi-scale features from different semantic depths, we construct a hierarchical multi-scale attention module (HMSAM) to enable the network to obtain global context more effectively. Finally, we design a multi-resolution semantic fusion module (MRSFM) to fuse high-resolution features and low-resolution features to obtain more accurate segmentation images. We conducted experiments on multiple datasets to verify the segmentation performance of the proposed model. The segmentation accuracy and mIoU (mean Intersection over Union) of the model on the CamVid (The Cambridge-driving Labeled Video Database) dataset were 93.94% and 80.53%, respectively, demonstrating our proposed approach’s usefulness.