Scholarlink

<p>We employ an evolutionary optimization framework that perturbs initial states to generate informative and diverse <i>reinforcement learning</i> (RL) policy demonstrations. A surrogate fitness function guides the optimization by combining local diversity, behavioral certainty, and global population diversity. To assess demonstration quality, we apply a set of evaluation metrics, including the reward-based optimality gap, fidelity <i>interquartile means</i> (IQMs), fitness composition analysis, and trajectory visualizations. Hyperparameter sensitivity is also examined to better understand the dynamics of trajectory optimization. Our findings demonstrate that optimizing trajectory selection via surrogate fitness metrics significantly improves the interpretability of RL policies in both discrete and continuous environments. In gridworld domains, evaluations reveal significantly enhanced demonstration fidelities compared to random and ablated baselines. In continuous control, the proposed framework provides valuable insights, particularly for early-stage policies, whereas fidelity-based optimization is more effective for mature policies. By refining and systematically analyzing surrogate fitness functions, this study advances the interpretability of RL models. The proposed improvements provide deeper insights into RL decision-making, benefiting applications in safety-critical and explainability-focused domains. </p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Surrogate Fitness Metrics for Interpretable Reinforcement Learning

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年3月30日

查看全文
  • Philipp Altmann,
  • Céline Davignon,
  • Maximilian Zorn,
  • Fabian Ritz,
  • Claudia Linnhoff-Popien,
  • Thomas Gabor

摘要

We employ an evolutionary optimization framework that perturbs initial states to generate informative and diverse reinforcement learning (RL) policy demonstrations. A surrogate fitness function guides the optimization by combining local diversity, behavioral certainty, and global population diversity. To assess demonstration quality, we apply a set of evaluation metrics, including the reward-based optimality gap, fidelity interquartile means (IQMs), fitness composition analysis, and trajectory visualizations. Hyperparameter sensitivity is also examined to better understand the dynamics of trajectory optimization. Our findings demonstrate that optimizing trajectory selection via surrogate fitness metrics significantly improves the interpretability of RL policies in both discrete and continuous environments. In gridworld domains, evaluations reveal significantly enhanced demonstration fidelities compared to random and ablated baselines. In continuous control, the proposed framework provides valuable insights, particularly for early-stage policies, whereas fidelity-based optimization is more effective for mature policies. By refining and systematically analyzing surrogate fitness functions, this study advances the interpretability of RL models. The proposed improvements provide deeper insights into RL decision-making, benefiting applications in safety-critical and explainability-focused domains.