Explainable AI and echo state networks calibrate trust in human machine interaction
摘要
Trust in human-machine interaction is a critical factor for the performance of AI systems, but achieving it is still challenging because many AI models are considered black-box. Following the purpose of the study, we quantitatively analyze the role of XAI and ESNs on the trust calibration with two different benchmark datasets, CIFAR-10 for visual tasks and SQuAD for text-based tasks. Using a 2 × 2 between-subjects experimental design, we examine the influence of AI explainability (explainable AI vs. non-explainable AI) and interaction outcomes (successful vs. failed) on explicit and implicit measures of trust. To increase the transparency of the model, convolution neural networks are joined with Explainable Artificial Intelligence (XAI) techniques including Grad-CAM for visual explainability and attention mechanisms for text-based tasks. This study shows explainable AI as a significant moderator of trust levels, especially in failed interactions and when users are given rationales for AI decisions. Explanations based on CNNs (Convolutional Neural Networks) improve the understanding, hence building trust, by providing visual evidence that is often easier to comprehend. Though implicit and explicit trust measures show strong correlations between the two measures, implicit metrics reveal differences in trust dynamics that cannot be gea-verified using self-reports. In addition, demographic factors, such as gender, have no significant impact on trust, further highlighting the versatility of these methods. The study compares its performance against five state-of-the-art methods in terms of accuracy, trust calibration, and user satisfaction and show that it outperforms them, while maintaining second best computational efficiency. These findings underscore the importance of explainability and dynamic trust calibration in ensuring the development of trusts in AI systems, providing a pathway for the widespread adoption of AI systems in various fields.