Objective <p>To develop and evaluate a comprehensive AI-driven pipeline for automated segmentation and multi-class classification of ovarian tumors in ultrasound images using advanced transformer-based models and radiomic analysis.</p> Materials and methods <p>The study was a multi-center, retrospective study that included ultrasound data of 1,907 patients in 4 clinical centers, with 1,364 patients being used as a model training and validation and 543 as an external test. Five transformer-based segmentation models were used to outline tumour regions namely SegFormer, Swin-UNet, DPT, nnU-Net and HRFormer. Dice Similarity Coefficient (DSC), Hausdorff Distance (HD) and Relative Absolute Volume Difference (RAVD) were used to measure segmentation accuracy. Radiomic features (<i>n</i> = 215) were taken out through SERA platform, following the IBSI instructions. Mutual Information (MI), LASSO and Recursive Feature Elimination (RFE) were used as feature selection methods. Five models were considered to classify them: TabTransformer, TabNet, MLP, XGBoost, and KAN. Three clinically significant classification tasks, including tumour type, histological subtype, and FIGO staging, were covered. The models were checked by five-fold cross-validation and externally tested. SHAP analysis delivered interpretability.</p> Results <p>SegFormer was found to be the most accurate in terms of segmentation (mean DSC &gt; 91%), which is higher than other U-Net-based models in earlier research. To classify, the TabTransformer selected by MI had the highest test accuracies in all tasks: tumour type (92.7 per cent.), histological subtype (92.1 per cent.), and FIGO stage (92.0 per cent). The accuracy of the external tests was over 90 per cent in all the tasks. SHAP analysis demonstrated the important radiomic features that make classification decisions, which is clinically transparent. There was no difference in performance between centers and imaging conditions.</p> Conclusions <p>The suggested pipeline proves to be very accurate, general and interpretable in automated ovarian cancer diagnostics based on ultrasound imaging. It provides a powerful framework of clinical implementation and future application with multimodal data to support decisions better.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Transformer-based ultrasound radiomics for novel multi-task automated segmentation and classification of ovarian tumors

  • Ahmed Faisal Mutee,
  • Ali Fawzi Al-Hussainy,
  • Nathier A. Ibrahim,
  • R. Roopashree,
  • Kabita Chanania,
  • Balasankar Karavadi,
  • Vipasha Sharma,
  • Aashna Sinha,
  • Obid Khamidov,
  • Hayder Naji Sameer,
  • Rasim M. Salih,
  • Mohaned Adil,
  • Bagher Farhood

摘要

Objective

To develop and evaluate a comprehensive AI-driven pipeline for automated segmentation and multi-class classification of ovarian tumors in ultrasound images using advanced transformer-based models and radiomic analysis.

Materials and methods

The study was a multi-center, retrospective study that included ultrasound data of 1,907 patients in 4 clinical centers, with 1,364 patients being used as a model training and validation and 543 as an external test. Five transformer-based segmentation models were used to outline tumour regions namely SegFormer, Swin-UNet, DPT, nnU-Net and HRFormer. Dice Similarity Coefficient (DSC), Hausdorff Distance (HD) and Relative Absolute Volume Difference (RAVD) were used to measure segmentation accuracy. Radiomic features (n = 215) were taken out through SERA platform, following the IBSI instructions. Mutual Information (MI), LASSO and Recursive Feature Elimination (RFE) were used as feature selection methods. Five models were considered to classify them: TabTransformer, TabNet, MLP, XGBoost, and KAN. Three clinically significant classification tasks, including tumour type, histological subtype, and FIGO staging, were covered. The models were checked by five-fold cross-validation and externally tested. SHAP analysis delivered interpretability.

Results

SegFormer was found to be the most accurate in terms of segmentation (mean DSC > 91%), which is higher than other U-Net-based models in earlier research. To classify, the TabTransformer selected by MI had the highest test accuracies in all tasks: tumour type (92.7 per cent.), histological subtype (92.1 per cent.), and FIGO stage (92.0 per cent). The accuracy of the external tests was over 90 per cent in all the tasks. SHAP analysis demonstrated the important radiomic features that make classification decisions, which is clinically transparent. There was no difference in performance between centers and imaging conditions.

Conclusions

The suggested pipeline proves to be very accurate, general and interpretable in automated ovarian cancer diagnostics based on ultrasound imaging. It provides a powerful framework of clinical implementation and future application with multimodal data to support decisions better.