A weakly supervised pavement crack segmentation based on adversarial learning and transformers
摘要
While pixel-level crack segmentation has demonstrated significant potential in infrastructure inspections, its reliance on detailed annotations poses challenges for widespread adoption due to the time-consuming and expensive nature of such labeling. In response, weakly supervised crack segmentation has garnered attention as it eliminates the need for pixel-level annotations. However, existing methods, primarily based on class activation maps (CAM), involve complex training processes and suffer from poor performance due to misalignment between CAM-generated labels and the true target in the image. To address these challenges, we propose a weakly supervised approach for crack segmentation that simultaneously generates synthetic crack images and performs segmentation through adversarial learning. Unlike traditional methods that rely on coarse labels, our approach leverages synthetic crack images with corresponding labels, effectively eliminating issues of misalignment and noisy pseudo-labels. Our method introduces an encoder-decoder architecture for the segmentation model, incorporating a Transformer-based Feature Enhancement module (TFE) in the encoder. This module is specifically designed to capture long-range dependencies and efficiently integrate both high- and low-level features. Additionally, the model includes a Hilo block to extract both high- and low-frequency information from the images, along with a Progressive Shrinking Decoder (PSD) to aggregate and refine adjacent feature maps. Extensive experiments were conducted, and our model achieved an ODS of 67.12% on the CrackForest dataset, 60.11% on the Crack500 dataset, and 44.80% on the AEL dataset. These results demonstrate that our model outperforms several existing weakly supervised pavement segmentation methods across these datasets.