Building trustworthiness in AI has become a critical task of AI governance to secure trustworthiness of AI systems/services. Since the trustworthiness concept is highly broad, its evaluation and implementation are tough tasks both for AI system/service providers and users. The authors previously developed a process to evaluate AI systems’ triste worthiness in terms of quality-in-use components. Using the systems’ functional requirements, but the mapping design was complicated and application specific. In this paper we propose an improved method to evaluate the quality-in-use components, utilizing quality components and these measurement indices based on ISO/IEC software quality standards. The method provides a unified, cross-application process by mapping vendor-implemented product/service quality components to quality-in-use components to derive quantitative evaluation results. We apply this method to an autonomous drone case study and analyze its effectiveness.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Revised Method of AI Quality-In-Use Evaluation and Its Application to AI-Enhanced Drone

  • Ryuichi Ogawa,
  • Yoichi Sagawa,
  • Shigeyoshi Shima,
  • Toshihiko Takemura,
  • Shin-ichi Fukuzumi

摘要

Building trustworthiness in AI has become a critical task of AI governance to secure trustworthiness of AI systems/services. Since the trustworthiness concept is highly broad, its evaluation and implementation are tough tasks both for AI system/service providers and users. The authors previously developed a process to evaluate AI systems’ triste worthiness in terms of quality-in-use components. Using the systems’ functional requirements, but the mapping design was complicated and application specific. In this paper we propose an improved method to evaluate the quality-in-use components, utilizing quality components and these measurement indices based on ISO/IEC software quality standards. The method provides a unified, cross-application process by mapping vendor-implemented product/service quality components to quality-in-use components to derive quantitative evaluation results. We apply this method to an autonomous drone case study and analyze its effectiveness.