The intelligent decision-making system has significant application value in fields such as autonomous driving and industrial control. However, the performance of existing decision systems largely depends on the quality of information acquisition and analysis, which leads to the following limitations. Firstly, high-precision information processing requires the configuration of high-performance sensors and computing units, which increases the system deployment cost and makes it unsuitable for resource-constrained scenarios. Secondly, in dynamic scenarios where the granularity of information gradually becomes clearer over time, the early coarse-grained information is not effectively utilized, causing the overall decision-making benefits to fall short of the theoretical upper bound. Therefore, this paper first designs a temporal scenario with progressively clarifying objectives, which simulates the dynamic characteristic of information granularity gradually improving as the agent approaches the target. Additionally, a risk assessment mechanism is incorporated into the decision-making process. Based on this scenario, a Two-Stage Multi-Objective Dynamic Policy Network (TSMODPN) is proposed. In this model, the first stage involves offline training of a strategy pool with diverse preferences, while the second stage employs an online dynamic policy network. This network first employs a dynamic distillation module to efficiently extract features from initial fuzzy information. Thereafter, the temporal preference selection module dynamically selects optimal strategies from the offline strategy pool based on these extracted features. The experimental results explicitly show that TSMODPN surpasses other baseline models in its ability to approach the theoretical upper bound for both safety benefits and task duration across varying risk levels.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Temporal Decision-Making Optimization for Intelligent Agents with Gradually Clarified Objectives

  • Chen Gu,
  • Guo Chen,
  • Fangwan Huang,
  • Xuanyun Liu,
  • Zhiyong Yu,
  • Yuezhong Wu

摘要

The intelligent decision-making system has significant application value in fields such as autonomous driving and industrial control. However, the performance of existing decision systems largely depends on the quality of information acquisition and analysis, which leads to the following limitations. Firstly, high-precision information processing requires the configuration of high-performance sensors and computing units, which increases the system deployment cost and makes it unsuitable for resource-constrained scenarios. Secondly, in dynamic scenarios where the granularity of information gradually becomes clearer over time, the early coarse-grained information is not effectively utilized, causing the overall decision-making benefits to fall short of the theoretical upper bound. Therefore, this paper first designs a temporal scenario with progressively clarifying objectives, which simulates the dynamic characteristic of information granularity gradually improving as the agent approaches the target. Additionally, a risk assessment mechanism is incorporated into the decision-making process. Based on this scenario, a Two-Stage Multi-Objective Dynamic Policy Network (TSMODPN) is proposed. In this model, the first stage involves offline training of a strategy pool with diverse preferences, while the second stage employs an online dynamic policy network. This network first employs a dynamic distillation module to efficiently extract features from initial fuzzy information. Thereafter, the temporal preference selection module dynamically selects optimal strategies from the offline strategy pool based on these extracted features. The experimental results explicitly show that TSMODPN surpasses other baseline models in its ability to approach the theoretical upper bound for both safety benefits and task duration across varying risk levels.