Fine-grained segmentation of spine MRI into vertebrae, intervertebral discs, and spinal canal, is critical for diagnosing complex spinal disorders. However, existing methods, which primarily rely on visual features, struggle with capturing the global anatomical understanding and pixel-level semantics. To address these challenges, we propose DP-Net, a dual-prompt-enhanced visual-language model with two key modules: The text insight enhancement module at the omni-level (TIEO) integrates global image context and anatomical distribution awareness into visual features, enhancing the model’s global understanding of the image. While the text insight enhancement module at the pixel-level (TIEP) further refines segmentation details by aligning semantics at the pixel level. These prompts are adaptively generated from the existing training data without additional textual annotations. Extensive experiments on the SPIDER and MRSpineSeg datasets demonstrate that DP-Net outperforms existing promising methods. For example, DP-Net achieves DSC \(\uparrow \) of 84.58 and HD95 \(\downarrow \) of 3.56 on SPIDER, surpassing the strong baseline model Swin-UMamba by +4.47% and −2.68, respectively.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Advancing Fine-Grained Spine Segmentation Through Visual-Language Model with Omni- and Pixel-Level Semantic Enhancements

  • Jianlong Cai,
  • Sheng Lian,
  • Dengfeng Pan,
  • Guangyong Chen,
  • Lei Li,
  • Zhiming Luo,
  • Shuo Li

摘要

Fine-grained segmentation of spine MRI into vertebrae, intervertebral discs, and spinal canal, is critical for diagnosing complex spinal disorders. However, existing methods, which primarily rely on visual features, struggle with capturing the global anatomical understanding and pixel-level semantics. To address these challenges, we propose DP-Net, a dual-prompt-enhanced visual-language model with two key modules: The text insight enhancement module at the omni-level (TIEO) integrates global image context and anatomical distribution awareness into visual features, enhancing the model’s global understanding of the image. While the text insight enhancement module at the pixel-level (TIEP) further refines segmentation details by aligning semantics at the pixel level. These prompts are adaptively generated from the existing training data without additional textual annotations. Extensive experiments on the SPIDER and MRSpineSeg datasets demonstrate that DP-Net outperforms existing promising methods. For example, DP-Net achieves DSC \(\uparrow \) of 84.58 and HD95 \(\downarrow \) of 3.56 on SPIDER, surpassing the strong baseline model Swin-UMamba by +4.47% and −2.68, respectively.