Evaluating cognitive biases in AI-assisted mammography interpretation: a simulation reader study of explainable AI across radiologist experience levels
摘要
To evaluate the impact of automation and anchoring bias in artificial intelligence (AI)-assisted mammography interpretation and to assess whether saliency-based explainable AI (XAI) mitigates these biases across radiologists of varying experience.
Materials and methodsIn this monocentric, fully crossed simulation reader study conducted between March and June 2024, six breast radiologists stratified by experience independently reviewed 200 mammograms under three sequential conditions: unassisted, AI-assisted, and AI-assisted with saliency-based XAI heatmaps. To quantify susceptibility to misleading AI advice under controlled discordance conditions, BI-RADS-like AI recommendations were deliberately perturbed by one category in 30% of examinations, whereas the remaining 70% retained the native AI output. Bias outcomes were analyzed using generalized linear mixed-effects models accounting for reader- and case-level clustering.
ResultsIn the AI-assisted condition without explanations, automation bias occurred in 65/180 (36.1%) and anchoring bias in 61/180 (33.9%) of manipulated cases. With XAI, these rates decreased to 32/180 (17.8%) and 31/180 (17.2%), respectively. In mixed-effects models, XAI was associated with lower odds of automation bias (aOR 0.56, 95% CI 0.44–0.71; p < 0.001) and anchoring-related revision bias (aOR 0.61, 95% CI 0.48–0.78; p < 0.001). On the non-manipulated subset, diagnostic accuracy improved from 724/840 (86.2%) in the unaided phase to 757/840 (90.1%) in the AI + XAI phase.
ConclusionAutomation and anchoring bias affected AI-assisted mammography interpretation, particularly among less experienced radiologists. Saliency-based explainable AI reduced, but did not eliminate, these effects.
Key Points