Mitigating Discontinuance in Medical AI Systems: The Role of AI Explanations
摘要
Despite significant advancements in medical artificial intelligence (AI) systems, these technologies are prone to mistake in their predictions. These mistakes can significantly affect medical experts’ willingness to continue using these systems. To mitigate potential discontinuation, existing research indicates that providing additional information alongside predictions, can lessen negative outcomes like discontinuation. Given the potential impact on users’ information processing, we hypothesize that AI explanations, detailing the system's decision-making process, can also influence the likelihood of discontinuing use after an AI mistake. Through an online experiment with medical experts (n = 227), we demonstrate that such explanations can influence medical experts’ information processing and, consequently, mitigate the adverse effects on the actual discontinuation of AI systems following a mistake.