Purpose <p>This paper presents a systematic literature review on the disruptive health and biomedical informatics technologies such as artificial intelligence (AI), that have accelerated medical operations from patient-centered medical experience data management to simplified medical procedures in this information era. As these technologies get integrated into traditional approaches, they raise critical technological and medical concerns, entailing transparency and interpretability of these AI models.</p> Method <p>Using Preferred Reporting Items for Systematic Reviews and Meta-Analyse (PRISMA) and 1,837 articles published between 2014 and 2024 from eight popular academic databases: PubMed, ACM Library, Springer, Scopus, IEEE Xplore, ScienceDirect, Google Scholar, and Web of Science based on the relevance of the AI method to healthcare and biomedicine.</p> Results <p>We included 148 articles in our review. The studied studies demonstrated that most medical people still find it complex to effectively explain the reasoning behind the decisions AI models make during biomedical experiments, leading to limited trust, biased decision-making, and unknown patient data safety. The main challenges are AI model intricacy, initial regulatory acceptance, usability, fairness, and predisposition.</p> Conclusion <p>Achieving a balance between AI explainability, fairness, and performance is fundamental to fostering ethical and responsible AI deployment in healthcare, ensuring improved patient outcomes and regulatory compliance. Limited studies are focusing on improving AI openness, trust, and interpretability. Model-agnostic strategies and explainable AI frameworks’ full implementation are inspected and ar. The availability of diverse and high-quality open datasets is indispensable for improving AI model interpretability; however, issues related to data privacy, standardization, and accessibility remain key concerns.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A systematic literature review on transparency and interpretability of AI models in healthcare: taxonomies, tools, techniques, datasets, open research challenges, and future trends

  • Wasswa Shafik,
  • Ahmad Fathan Hidayatullah,
  • Kassim Kalinaki,
  • Haji Gul,
  • Rufai Yusuf Zakari,
  • Ali Tufail

摘要

Purpose

This paper presents a systematic literature review on the disruptive health and biomedical informatics technologies such as artificial intelligence (AI), that have accelerated medical operations from patient-centered medical experience data management to simplified medical procedures in this information era. As these technologies get integrated into traditional approaches, they raise critical technological and medical concerns, entailing transparency and interpretability of these AI models.

Method

Using Preferred Reporting Items for Systematic Reviews and Meta-Analyse (PRISMA) and 1,837 articles published between 2014 and 2024 from eight popular academic databases: PubMed, ACM Library, Springer, Scopus, IEEE Xplore, ScienceDirect, Google Scholar, and Web of Science based on the relevance of the AI method to healthcare and biomedicine.

Results

We included 148 articles in our review. The studied studies demonstrated that most medical people still find it complex to effectively explain the reasoning behind the decisions AI models make during biomedical experiments, leading to limited trust, biased decision-making, and unknown patient data safety. The main challenges are AI model intricacy, initial regulatory acceptance, usability, fairness, and predisposition.

Conclusion

Achieving a balance between AI explainability, fairness, and performance is fundamental to fostering ethical and responsible AI deployment in healthcare, ensuring improved patient outcomes and regulatory compliance. Limited studies are focusing on improving AI openness, trust, and interpretability. Model-agnostic strategies and explainable AI frameworks’ full implementation are inspected and ar. The availability of diverse and high-quality open datasets is indispensable for improving AI model interpretability; however, issues related to data privacy, standardization, and accessibility remain key concerns.