A Comparative Analysis of SHAP and LIME for Model Interpretability in Automated Machine Learning Using Pycaret and TPOT Across Diverse Datasets
摘要
Today’s artificial intelligence (AI), powered by advanced Machine Learning (ML), is achieving remarkable success in various fields. Advanced ML techniques drive it and demonstrate significant achievements across multiple domains. However, these systems’ inherent lack of comprehensibility challenges their implementation in critical sectors. To address this issue, eXplainable Artificial Intelligence (XAI) methodologies have been developed to enhance the interpretability of models for their decision-making processes. This paper presents a comparative analysis of two prominent XAI libraries, SHapley Additive exPlanations (SHAP) and Local Interpretable Model-agnostic Explanations (LIME), along with an evaluation of their performance in conjunction with two Automated Machine Learning (AutoML) tools, Pycaret and TPOT, across five distinct datasets.