Explainable Artificial Intelligence as a Service: Algorithms for Evaluation of Characteristics
摘要
This paper addresses methods for evaluating Explainable Artificial Intelligence as a Service (XAIaaS). Existing approaches to evaluating explainable artificial intelligence systems are analyzed. The study aims to develop a method and an evaluation procedure for determining the quality of explainable artificial intelligence systems within the XAIaaS model based on a characteristic-oriented methodology. A multilevel evaluation scheme is proposed, which involves step-by-step analysis, testing, and refinement relying on the key characteristics defined at the first level of the quality model hierarchy. The scheme enables performing a targeted, structured, and comparative assessment of individual properties of the system as a whole. The applicability of the proposed methodology is demonstrated using a practical example.