Abstract <p>The advent of deep learning has significantly advanced the state of the art in cardiac magnetic resonance (CMR) image segmentation. However, most models remain task-specific, which hinders the development and validation of approaches generalizable across different clinical centers, imaging protocols, or scanner vendors. Vision foundation models (VFMs), pre-trained on large-scale natural image datasets, offer powerful and transferable representations under the “pre-training and fine-tuning” paradigm. Nevertheless, adapting them to CMR segmentation faces two major challenges: (1) the substantial domain gap between natural and medical images limits transferability; and (2) extracting domain-agnostic features from diverse domain styles represents a key bottleneck for domain generalization with VFMs. To address these issues, we propose a scenario-activated fine-tuning initialization strategy that adapts VFMs to MRI characteristics and employs singular value decomposition to extract principal components for parameter-efficient tuning. This approach enables robust domain-generalized CMR segmentation. Additionally, we apply Haar wavelet transforms to disentangle style information from domain-invariant content. The former helps stabilize scene content, while the latter captures scene style and mitigates its impact on domain-generalized semantic segmentation. Experiments under various CMR domain generalization segmentation settings demonstrate the state-of-the-art performance of our FA-SedLoRA framework and its versatility across different VFMs.</p> Graphical abstract <p></p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

FA-SedLoRA: scene-driven fine-tuning and style disentanglement for domain-generalized cardiac MRI segmentation

  • Congling Wang,
  • Ping Peng,
  • Xizhi Wang

摘要

Abstract

The advent of deep learning has significantly advanced the state of the art in cardiac magnetic resonance (CMR) image segmentation. However, most models remain task-specific, which hinders the development and validation of approaches generalizable across different clinical centers, imaging protocols, or scanner vendors. Vision foundation models (VFMs), pre-trained on large-scale natural image datasets, offer powerful and transferable representations under the “pre-training and fine-tuning” paradigm. Nevertheless, adapting them to CMR segmentation faces two major challenges: (1) the substantial domain gap between natural and medical images limits transferability; and (2) extracting domain-agnostic features from diverse domain styles represents a key bottleneck for domain generalization with VFMs. To address these issues, we propose a scenario-activated fine-tuning initialization strategy that adapts VFMs to MRI characteristics and employs singular value decomposition to extract principal components for parameter-efficient tuning. This approach enables robust domain-generalized CMR segmentation. Additionally, we apply Haar wavelet transforms to disentangle style information from domain-invariant content. The former helps stabilize scene content, while the latter captures scene style and mitigates its impact on domain-generalized semantic segmentation. Experiments under various CMR domain generalization segmentation settings demonstrate the state-of-the-art performance of our FA-SedLoRA framework and its versatility across different VFMs.

Graphical abstract