In recent years, deep learning-based vessel segmentation methods have made significant progress. However, the diversity of image modalities and the high-cost of acquiring sufficient annotated data constrain the performance of existing approaches. Given that the primary objective of segmenting various types of vessels is to extract high-frequency tubular structures, leveraging existing annotated datasets for training and fast generalizing to novel vessel segmentation tasks is an ideal solution to the above challenges, which can be achieved by the few-shot segmentation (FSS) paradigm. Unfortunately, the significant differences in texture and thickness among different types of vessels leave unsolved challenges. To address this issue, we propose a novel framework that incorporates FSS into cross-domain vessel segmentation. In particular, we construct high-frequency auxiliary modalities to guide the model in focusing on high-frequency features, which are highly correlated with vessel regions, thereby bridging the texture gap between images of various vessel types. Furthermore, we design a Dual-Modal Feature Extraction and Fusion (DM-FEF) module to extract modality-specific features. Finally, addressing the thickness variations between different vessels, we designed a Multi-Branch Feature Extractor (MBFE) module to capture the diverse characteristics of vessels with different thickness, enabling the model to perceive the thickness differences between distinct vessels. Experimental results on six public datasets demonstrate the effectiveness of our method. Source code: https://github.com/ZiH-Huang/FSS_Cross .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Multi-Branch Framework for Cross-Domain Vessel Segmentation via the Few-Shot Paradigm

  • Zihang Huang,
  • Tianyu Zhao,
  • Liang Zhang,
  • Xin Yang

摘要

In recent years, deep learning-based vessel segmentation methods have made significant progress. However, the diversity of image modalities and the high-cost of acquiring sufficient annotated data constrain the performance of existing approaches. Given that the primary objective of segmenting various types of vessels is to extract high-frequency tubular structures, leveraging existing annotated datasets for training and fast generalizing to novel vessel segmentation tasks is an ideal solution to the above challenges, which can be achieved by the few-shot segmentation (FSS) paradigm. Unfortunately, the significant differences in texture and thickness among different types of vessels leave unsolved challenges. To address this issue, we propose a novel framework that incorporates FSS into cross-domain vessel segmentation. In particular, we construct high-frequency auxiliary modalities to guide the model in focusing on high-frequency features, which are highly correlated with vessel regions, thereby bridging the texture gap between images of various vessel types. Furthermore, we design a Dual-Modal Feature Extraction and Fusion (DM-FEF) module to extract modality-specific features. Finally, addressing the thickness variations between different vessels, we designed a Multi-Branch Feature Extractor (MBFE) module to capture the diverse characteristics of vessels with different thickness, enabling the model to perceive the thickness differences between distinct vessels. Experimental results on six public datasets demonstrate the effectiveness of our method. Source code: https://github.com/ZiH-Huang/FSS_Cross .