Explainable Deep Reinforcement Learning (XDRL) holds significant potential for clarifying the decision-making logic of agents in complex tasks. Current XDRL research increasingly focuses on multi-granularity policy explanation methods that integrate both local and global decision-making insights. However, most of them treat local and global explanations as separate processes, overlooking their interdependencies and compromising logical consistency. This paper introduces a Multi-granularity Policy eXplanation method based on Saliency map Clustering (MPXSC), which computes both local and global policy explanations for a DRL agent in a unified, end-to-end process. MPXSC begins by employing super-pixel perturbation to generate saliency maps for all the agent’s states, representing its local explanation. These maps are then categorized by agent's actions and clustered based on local saliency features. Subsequently, the key states within each cluster are identified and serve as decision rules for their respective actions. Collectively, these results constitute the global explanation for the agent's decision-making. The superiority of MPXSC is validated through objective experiments on both local and global explanations, with a case study visually demonstrating the method’s compelling explainable evidence regarding DRL model prediction outcomes.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multi-granularity Policy Explanation of Deep Reinforcement Learning Based on Saliency Map Clustering

  • Yujiao Wang,
  • Hai Huang,
  • Xingquan Zuo

摘要

Explainable Deep Reinforcement Learning (XDRL) holds significant potential for clarifying the decision-making logic of agents in complex tasks. Current XDRL research increasingly focuses on multi-granularity policy explanation methods that integrate both local and global decision-making insights. However, most of them treat local and global explanations as separate processes, overlooking their interdependencies and compromising logical consistency. This paper introduces a Multi-granularity Policy eXplanation method based on Saliency map Clustering (MPXSC), which computes both local and global policy explanations for a DRL agent in a unified, end-to-end process. MPXSC begins by employing super-pixel perturbation to generate saliency maps for all the agent’s states, representing its local explanation. These maps are then categorized by agent's actions and clustered based on local saliency features. Subsequently, the key states within each cluster are identified and serve as decision rules for their respective actions. Collectively, these results constitute the global explanation for the agent's decision-making. The superiority of MPXSC is validated through objective experiments on both local and global explanations, with a case study visually demonstrating the method’s compelling explainable evidence regarding DRL model prediction outcomes.