<p>Despite many success stories along the path of Artificial Intelligence’s (AI) rise in healthcare, there are comparably many reports of significant shortcomings and unexpected behavior of AI in deployment. A major risk is AI’s reliance on association-based learning, where non-representative machine learning datasets can amplify latent bias during training and hide it during testing. To unlock new tools capable of detecting such AI bias issues, we present Generalized Attribute Utility and Detectability-Induced bias Testing (G-AUDIT). G-AUDIT is a data modality-agnostic dataset auditing approach that automatically quantifies shortcut learning risks by examining the interplay between task-level annotations, sensor-level measurements, and patient, environmental, and acquisition characteristics. We demonstrate the broad applicability of this method by analyzing a range of medical datasets across three distinct modalities (images, text, and tabular data) and machine learning tasks, successfully identifying potential shortcuts commonly overlooked by traditional qualitative methods.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Detecting dataset bias in medical AI using a generalized and modality agnostic auditing approach

  • Nathan Drenkow,
  • Mitchell Pavlak,
  • Keith Harrigian,
  • Ayah Zirikly,
  • Adarsh Subbaswamy,
  • Mohammad Mehdi Farhangi,
  • Nicholas Petrick,
  • Mathias Unberath

摘要

Despite many success stories along the path of Artificial Intelligence’s (AI) rise in healthcare, there are comparably many reports of significant shortcomings and unexpected behavior of AI in deployment. A major risk is AI’s reliance on association-based learning, where non-representative machine learning datasets can amplify latent bias during training and hide it during testing. To unlock new tools capable of detecting such AI bias issues, we present Generalized Attribute Utility and Detectability-Induced bias Testing (G-AUDIT). G-AUDIT is a data modality-agnostic dataset auditing approach that automatically quantifies shortcut learning risks by examining the interplay between task-level annotations, sensor-level measurements, and patient, environmental, and acquisition characteristics. We demonstrate the broad applicability of this method by analyzing a range of medical datasets across three distinct modalities (images, text, and tabular data) and machine learning tasks, successfully identifying potential shortcuts commonly overlooked by traditional qualitative methods.