RadImageGAN – A Multi-modal Dataset-Scale Generative AI for Medical Imaging
摘要
Deep learning in medical imaging often requires large-scale, high-quality data, or initiation with suitably pre-trained weights. However, medical datasets are limited by data availability, domain-specific knowledge, and privacy concerns, and the creation of large and diverse radiologic databases like RadImageNet is highly resource-intensive. To address these limitations, we introduce RadImageGAN, a multi-modal medical image generator developed by training StyleGAN-XL on the RadImageNet dataset of CT and MRI images and the HyperKvasir dataset of gastrointestinal images. RadImageGAN can generate high-resolution synthetic medical imaging datasets across 12 anatomical regions and 130 pathological classes in 3 modalities. Furthermore, we developed the RadImageGAN-Labeler, which can generate multi-class pixel-wise annotated paired synthetic images and masks for diverse downstream segmentation tasks with minimal manual annotation. Using synthetic auto-labeled data from RadImageGAN can significantly improve performance on four diverse downstream segmentation datasets by augmenting real training data. We find that RadImageGAN can improve model performance and address data scarcity while reducing the resources needed for annotations for segmentation tasks.