While Masked Image Modeling (MIM) has revolutionized fields of computer vision, its adoption in 3D medical image computing has been limited by the use of random masking, which overlooks the density of anatomical objects. To address this limitation, we enhance the pretext task with a simple yet effective masking strategy. Leveraging Hounsfield Unit (HU) measurements, we implement an HU-based Foreground Masking, which focuses on the intensity distribution of visceral organs and excludes non-tissue regions, such as air and fluid, that lack diagnostically meaningful features. Extensive experiments on five public 3D medical imaging datasets demonstrate that our masking consistently improves performance, both in quality of segmentation and Dice score (BTCV: 84.64%, Flare22: 92.43%, MM-WHS: 90.67%, Amos22: 88.64%, BraTS: 78.55%). These results underscore the importance of domain-centric MIM and suggest a promising direction for representation learning in medical image segmentation. Implementation is available at https://github.com/AISeedHub/SubFore/ .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

HU-Based Foreground Masking for 3D Medical Masked Image Modeling

  • Jin Lee,
  • Vu Dang,
  • Gwang-Hyun Yu,
  • Anh Le,
  • Zahid Rahman,
  • Jin-Ho Jang,
  • Heonzoo Lee,
  • Kun-Yung Kim,
  • Jin-Sul Kim,
  • Jin-Young Kim

摘要

While Masked Image Modeling (MIM) has revolutionized fields of computer vision, its adoption in 3D medical image computing has been limited by the use of random masking, which overlooks the density of anatomical objects. To address this limitation, we enhance the pretext task with a simple yet effective masking strategy. Leveraging Hounsfield Unit (HU) measurements, we implement an HU-based Foreground Masking, which focuses on the intensity distribution of visceral organs and excludes non-tissue regions, such as air and fluid, that lack diagnostically meaningful features. Extensive experiments on five public 3D medical imaging datasets demonstrate that our masking consistently improves performance, both in quality of segmentation and Dice score (BTCV: 84.64%, Flare22: 92.43%, MM-WHS: 90.67%, Amos22: 88.64%, BraTS: 78.55%). These results underscore the importance of domain-centric MIM and suggest a promising direction for representation learning in medical image segmentation. Implementation is available at https://github.com/AISeedHub/SubFore/ .