Background <p>Commercial artificial intelligence (AI) software for cardiac magnetic resonance (CMR) analysis has shown promising internal validation results, but independent external validation in distinct clinical settings remains limited. This study aimed to externally validate a commercially available AI system for biventricular parameters and per-segmental left ventricular wall thickness (LVWT) measurements in a prospective cohort independent from the training data.</p> Methods <p>In this prospective study, 100 healthy Chinese volunteers (67 men; age 20—63&#xa0;years) from a single center (The Central Hospital of Wuhan) underwent 3.0&#xa0;T CMR with cine short-axis and long-axis sequences. Biventricular parameters and per-segmental LVWT were measured by commercial AI software (SHUKUN) and a single senior cardiac radiologist with 9&#xa0;years of experience. Paired <i>t</i> tests, Wilcoxon rank-sum tests, interclass correlation coefficient (ICC), and Spearman correlation were performed. Bland–Altman and Bull's-eye plots were generated.</p> Results <p>AI and manual measurements showed good to excellent consistency and correlation for most biventricular parameters in males and the entire cohort (ICCs = 0.551—0.922; r = 0.656—0.910; all p &lt; 0.05), except right ventricular ejection fraction (r = 0.374, ICC = 0.330). Female subjects showed greater variability. For per-segmental LVWT, most segments demonstrated good agreement (ICCs = 0.415—0.776; r = 0.436—0.794; all p &lt; 0.05), with suboptimal performance in anterior and apical segments.</p> Conclusion <p>This independent external validation demonstrates that commercial AI software has good consistency with manual measurements for most cardiac parameters in healthy adults. However, manual verification remains necessary for segmental LVWT analysis, particularly in female subjects. Validation in diseased populations is warranted before clinical implementation.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Investigation of Concordance between Artificial Intelligence and Manual Measurements of the Cardiac Parameters in Cardiac Magnetic Resonance Imaging

  • Ruiyao Tang,
  • Ziqian Xu,
  • Zengfa Huang,
  • Wanpeng Wang,
  • Xi Wang,
  • Zuoqin Li,
  • Guijuan Cao,
  • You Li,
  • Fen Liu,
  • Feng Ma,
  • Zihao Liu,
  • Yucheng Chen,
  • Xiang Wang

摘要

Background

Commercial artificial intelligence (AI) software for cardiac magnetic resonance (CMR) analysis has shown promising internal validation results, but independent external validation in distinct clinical settings remains limited. This study aimed to externally validate a commercially available AI system for biventricular parameters and per-segmental left ventricular wall thickness (LVWT) measurements in a prospective cohort independent from the training data.

Methods

In this prospective study, 100 healthy Chinese volunteers (67 men; age 20—63 years) from a single center (The Central Hospital of Wuhan) underwent 3.0 T CMR with cine short-axis and long-axis sequences. Biventricular parameters and per-segmental LVWT were measured by commercial AI software (SHUKUN) and a single senior cardiac radiologist with 9 years of experience. Paired t tests, Wilcoxon rank-sum tests, interclass correlation coefficient (ICC), and Spearman correlation were performed. Bland–Altman and Bull's-eye plots were generated.

Results

AI and manual measurements showed good to excellent consistency and correlation for most biventricular parameters in males and the entire cohort (ICCs = 0.551—0.922; r = 0.656—0.910; all p < 0.05), except right ventricular ejection fraction (r = 0.374, ICC = 0.330). Female subjects showed greater variability. For per-segmental LVWT, most segments demonstrated good agreement (ICCs = 0.415—0.776; r = 0.436—0.794; all p < 0.05), with suboptimal performance in anterior and apical segments.

Conclusion

This independent external validation demonstrates that commercial AI software has good consistency with manual measurements for most cardiac parameters in healthy adults. However, manual verification remains necessary for segmental LVWT analysis, particularly in female subjects. Validation in diseased populations is warranted before clinical implementation.