Objectives <p>To evaluate triaging scenarios involving two commercial AI algorithms to enhance mammography interpretation and reduce workload.</p> Materials and methods <p>A total of 3012 screening or diagnostic mammograms, including 213 cancer cases, were analyzed using two AI algorithms (AI-1, AI-2) and categorized as “high-risk” (top 10%), “minimal-risk” (bottom 20%), or “indeterminate” based on malignancy likelihood. Five triaging scenarios of combined AI use (Sensitive, Specific, Conservative, Sequential Modes A and B) determined whether cases would be autonomously recalled, classified as negative, or referred for radiologist interpretation. Sensitivity, specificity, number of mammograms requiring review, and abnormal interpretation rate (AIR) were compared against single AIs and manual reading using McNemar’s test.</p> Results <p>Sensitive Mode achieved 84% sensitivity, outperforming single AI (<i>p</i> = 0.03 [AI-1], 0.01 [AI-2]) and manual reading (<i>p</i> = 0.03), with an 18.3% reduction in mammograms requiring review (AIR, 23.3%). Specific Mode achieved 87.7% specificity, exceeding single AI (<i>p</i> &lt; 0.001 [AI-1, AI-2]) and comparable to manual reading (<i>p</i> = 0.37), with a 41.7% reduction in mammograms requiring review (AIR, 17%). Conservative and Sequential Modes A and B achieved sensitivities of 82.2%, 80.8%, and 80.3%, respectively, comparable to single AI or manual reading (<i>p</i> &gt; 0.05, all), with reductions of 9.8%, 49.8%, and 49.8% in mammograms requiring review (AIRs, 18.6%, 21.6%, 21.7%).</p> Conclusion <p>Combining two AI algorithms improved sensitivity or specificity in mammography interpretation while reducing mammograms requiring radiologist review in this cancer-enriched dataset from a tertiary center. Scenario selection should consider clinical needs and requires validation in a screening population.</p> Key Points <p><Emphasis Type="BoldItalic">Question</Emphasis> <i>AI algorithms have the potential to improve workflow efficiency by triaging mammograms. Combining algorithms trained under different conditions may offer synergistic benefits.</i></p> <p><Emphasis Type="BoldItalic">Findings</Emphasis> <i>The combined use of two commercial AI algorithms for triaging mammograms improved sensitivity or specificity, depending on the scenario, while also reducing mammograms requiring radiologist review.</i></p> <p><Emphasis Type="BoldItalic">Clinical relevance</Emphasis> <i>Integrating two commercial AI algorithms could enhance mammography interpretation over using a single AI for triaging or manual reading.</i></p> Graphical Abstract <p></p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Combined use of two artificial intelligence-based algorithms for mammography triaging: a retrospective simulation study

  • Hee Jeong Kim,
  • Hak Hee Kim,
  • Hye Joung Eom,
  • Woo Jung Choi,
  • Eun Young Chae,
  • Hee Jung Shin,
  • Joo Hee Cha

摘要

Objectives

To evaluate triaging scenarios involving two commercial AI algorithms to enhance mammography interpretation and reduce workload.

Materials and methods

A total of 3012 screening or diagnostic mammograms, including 213 cancer cases, were analyzed using two AI algorithms (AI-1, AI-2) and categorized as “high-risk” (top 10%), “minimal-risk” (bottom 20%), or “indeterminate” based on malignancy likelihood. Five triaging scenarios of combined AI use (Sensitive, Specific, Conservative, Sequential Modes A and B) determined whether cases would be autonomously recalled, classified as negative, or referred for radiologist interpretation. Sensitivity, specificity, number of mammograms requiring review, and abnormal interpretation rate (AIR) were compared against single AIs and manual reading using McNemar’s test.

Results

Sensitive Mode achieved 84% sensitivity, outperforming single AI (p = 0.03 [AI-1], 0.01 [AI-2]) and manual reading (p = 0.03), with an 18.3% reduction in mammograms requiring review (AIR, 23.3%). Specific Mode achieved 87.7% specificity, exceeding single AI (p < 0.001 [AI-1, AI-2]) and comparable to manual reading (p = 0.37), with a 41.7% reduction in mammograms requiring review (AIR, 17%). Conservative and Sequential Modes A and B achieved sensitivities of 82.2%, 80.8%, and 80.3%, respectively, comparable to single AI or manual reading (p > 0.05, all), with reductions of 9.8%, 49.8%, and 49.8% in mammograms requiring review (AIRs, 18.6%, 21.6%, 21.7%).

Conclusion

Combining two AI algorithms improved sensitivity or specificity in mammography interpretation while reducing mammograms requiring radiologist review in this cancer-enriched dataset from a tertiary center. Scenario selection should consider clinical needs and requires validation in a screening population.

Key Points

Question AI algorithms have the potential to improve workflow efficiency by triaging mammograms. Combining algorithms trained under different conditions may offer synergistic benefits.

Findings The combined use of two commercial AI algorithms for triaging mammograms improved sensitivity or specificity, depending on the scenario, while also reducing mammograms requiring radiologist review.

Clinical relevance Integrating two commercial AI algorithms could enhance mammography interpretation over using a single AI for triaging or manual reading.

Graphical Abstract