Semi-supervised semantic segmentation (SSS) aims to alleviate the burden of time-consuming pixel-level manual labeling. Current mainstream methods typically adopt a teacher-student framework based on pseudo-labeling, where the teacher model generates pseudo-labels to guide the training of the student model on the unlabeled data. However, these pseudo-labels commonly contain noise, which leads to accumulated loss during training and significantly degrades the model performance finally. Furthermore, simply discarding low-quality predictions is improper for resulting in inefficient training samples utilization. To address the above issues in SSS, we propose an Enhanced Teacher-Student Framework with Weighted Loss and Presence Awareness (TeSuLoPA), which improves the quality and utilization of pseudo-labels through collaborative optimization. Initially, a Local Enhancement Fusion Encoder combines enhanced local features with original features to capture comprehensive contextual information to obtain reliable pseudo-labels. Secondly, we design a Dynamic Loss Weighting strategy that dynamically assigns sample- and batch-wise weights to predictions based on their quality, enabling effective utilization of both high- and low-quality pseudo-labels. Additionally, an Auxiliary Presence Awareness model evaluates the reliability of pseudo-labels to support batch-wise loss weighting and generates foreground predictions to supply auxiliary signals for the student model. Experiments on SSS benchmarks demonstrate that the proposed TeSuLoPA outperforms most existing methods. Specifically, on Pascal VOC 2012 datasets with only 183 labels, it achieves a 2.29% mIoU gain over the state-of-the-art method.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhanced Teacher-Student Framework with Weighted Loss and Presence Awareness for Semi-supervised Semantic Segmentation

  • Peng Liu,
  • Chengcheng Zhou,
  • Kecheng Liu,
  • Hengyu Cao,
  • Xuekui Wang,
  • Bing Liu

摘要

Semi-supervised semantic segmentation (SSS) aims to alleviate the burden of time-consuming pixel-level manual labeling. Current mainstream methods typically adopt a teacher-student framework based on pseudo-labeling, where the teacher model generates pseudo-labels to guide the training of the student model on the unlabeled data. However, these pseudo-labels commonly contain noise, which leads to accumulated loss during training and significantly degrades the model performance finally. Furthermore, simply discarding low-quality predictions is improper for resulting in inefficient training samples utilization. To address the above issues in SSS, we propose an Enhanced Teacher-Student Framework with Weighted Loss and Presence Awareness (TeSuLoPA), which improves the quality and utilization of pseudo-labels through collaborative optimization. Initially, a Local Enhancement Fusion Encoder combines enhanced local features with original features to capture comprehensive contextual information to obtain reliable pseudo-labels. Secondly, we design a Dynamic Loss Weighting strategy that dynamically assigns sample- and batch-wise weights to predictions based on their quality, enabling effective utilization of both high- and low-quality pseudo-labels. Additionally, an Auxiliary Presence Awareness model evaluates the reliability of pseudo-labels to support batch-wise loss weighting and generates foreground predictions to supply auxiliary signals for the student model. Experiments on SSS benchmarks demonstrate that the proposed TeSuLoPA outperforms most existing methods. Specifically, on Pascal VOC 2012 datasets with only 183 labels, it achieves a 2.29% mIoU gain over the state-of-the-art method.