<p>Explainability has increasingly become a core requirement for intelligent medical devices. Current medical artificial intelligence (AI) technologies suffer from the ‘interpretability gap’ despite tremendous efforts for enhancing explainability. Here we propose class-association manifold learning, a generative approach that enhances explainability of medical AI models. Our method efficiently decouples common decision-related patterns from individual backgrounds, enabling us to represent global class-associated knowledge in a low-dimensional mapping while preserving near-perfect diagnostic accuracy. The extracted knowledge is further used to enable AI-generated modifications on arbitrary samples and visualize differential diagnosis rules. Moreover, we develop a topology map to model the entire decision rule set, so that the logic underlying black-box models can be intuitively explicated by traversing the map and generating virtual contrastive examples. Extensive experiments show that our method not only achieves higher accuracy in explaining the behaviour of medical AI models but also helps with extracting medical-compliant knowledge that are unknown during model training, thus providing a potential means of assisting clinical rule and medical knowledge discovery with AI techniques.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Bridging the interpretability gap for medical artificial intelligence models using class-association manifold learning

  • Ruitao Xie,
  • Xiaoxi He,
  • Limai Jiang,
  • Mini Han Wang,
  • Jingbang Chen,
  • Rui Xiao,
  • Bokai Yang,
  • Ye Li,
  • Jinling Tang,
  • Yi Pan,
  • Yunpeng Cai

摘要

Explainability has increasingly become a core requirement for intelligent medical devices. Current medical artificial intelligence (AI) technologies suffer from the ‘interpretability gap’ despite tremendous efforts for enhancing explainability. Here we propose class-association manifold learning, a generative approach that enhances explainability of medical AI models. Our method efficiently decouples common decision-related patterns from individual backgrounds, enabling us to represent global class-associated knowledge in a low-dimensional mapping while preserving near-perfect diagnostic accuracy. The extracted knowledge is further used to enable AI-generated modifications on arbitrary samples and visualize differential diagnosis rules. Moreover, we develop a topology map to model the entire decision rule set, so that the logic underlying black-box models can be intuitively explicated by traversing the map and generating virtual contrastive examples. Extensive experiments show that our method not only achieves higher accuracy in explaining the behaviour of medical AI models but also helps with extracting medical-compliant knowledge that are unknown during model training, thus providing a potential means of assisting clinical rule and medical knowledge discovery with AI techniques.