This paper based on the characteristics of plume diffusion, employs the Realizable \(\mathrm {k-\varepsilon }\) model for implicit unsteady-state calculations to simulate the diffusion process of pollutants. Additionally, it applies the SAC (Soft Actor-Critic) deep reinforcement learning algorithm to study its effectiveness in tracing pollution sources in reservoirs. The research results show that, compared to the Comb-shaped Search Path strategy, the SAC-based source tracing strategy achieves approximately 12 times improvement in time efficiency and converges faster. The capability of the SAC algorithm in handling continuous state and action spaces, combined with its entropy-maximizing objective and adaptive temperature coefficient ( \(\alpha \) ), provides strong exploration capabilities and robustness. Simulation results confirm the algorithm’s effectiveness: after an initial exploratory phase with Gaussian noise (first 50 episodes), the agent’s cumulative reward significantly increased, converging stably to around 1000 by episode 75. This indicates the discovery of a near-optimal policy for locating the pollution source from various starting points. The results validate SAC as a viable and efficient approach for this complex environmental task.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

SAC-Based Strategy Solving for Reservoir Pollutant Source Tracing by AUV

  • Taofeng Wang,
  • Wenhao Li,
  • Weilin Zang,
  • Sanming Song

摘要

This paper based on the characteristics of plume diffusion, employs the Realizable \(\mathrm {k-\varepsilon }\) model for implicit unsteady-state calculations to simulate the diffusion process of pollutants. Additionally, it applies the SAC (Soft Actor-Critic) deep reinforcement learning algorithm to study its effectiveness in tracing pollution sources in reservoirs. The research results show that, compared to the Comb-shaped Search Path strategy, the SAC-based source tracing strategy achieves approximately 12 times improvement in time efficiency and converges faster. The capability of the SAC algorithm in handling continuous state and action spaces, combined with its entropy-maximizing objective and adaptive temperature coefficient ( \(\alpha \) ), provides strong exploration capabilities and robustness. Simulation results confirm the algorithm’s effectiveness: after an initial exploratory phase with Gaussian noise (first 50 episodes), the agent’s cumulative reward significantly increased, converging stably to around 1000 by episode 75. This indicates the discovery of a near-optimal policy for locating the pollution source from various starting points. The results validate SAC as a viable and efficient approach for this complex environmental task.