Measuring Fairness in AI Explanations with LEADR: Local Explanation Amplification Disparity Ratio
摘要
We investigate the fairness of local explanations in AI models by comparing the mean explanations for privileged and unprivileged groups across various datasets and model types. Specifically, we train linear, multi-layer perceptron, and explainable boosting machine (EBM) models, on several key academic datasets. Local explanations are generated using both post-hoc methods (LIME), and direct methods - logistic regression, integrated gradients and EBM local feature importance. By comparing these explanations across models and methods, we introduce a new metric, the Local Explanation Amplification Disparity Ratio (LEADR), to measure disparities in feature attribution between privileged and unprivileged groups. Our preliminary findings suggest that transparent Whitebox models may exhibit a tendency to display greater disparity in bias than opaque Blackbox models. This insight encourages further research into bias mitigation strategies that are tailored to different algorithm types, with the goal of minimizing undesired bias in AI systems.