Scholarlink

<p>Autonomous orbital pursuit–evasion represents a complex differential game with impulsive dynamics and stochastic adversarial maneuvers. Although model-free reinforcement learning has shown promise in high-dimensional decision-making, it often suffers from slow convergence and instability, mainly due to high-variance value estimation caused by unobservable evader maneuvers. This paper proposes a Physics-Informed Proximal Policy Optimization (PI-PPO) framework featuring a dual-correction closed-loop mechanism. A Kalman-driven opponent-modeling module dynamically estimates impulsive maneuvers, enabling accurate physical prediction under maneuvering uncertainty and correcting the systematic prediction bias of the orbital dynamics model. Furthermore, a physics-consistency loss derived from the Clohessy–Wiltshire equations is incorporated into the critic to regularize value learning and promote physical coherence. These two mechanisms establish a closed loop where data corrects physics and physics constrains learning, ensuring lower-variance and more stable policy updates. Simulation results in impulsive orbital pursuit scenarios demonstrate that the proposed method achieves faster convergence, higher sample efficiency, and stronger robustness against maneuver uncertainty compared with baseline algorithms.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

A physics-informed reinforcement learning framework for impulsive orbital pursuit–evasion under stochastic maneuvers

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2026年5月25日

查看全文
  • Yuteng Li,
  • Shiwei Lin,
  • Bomin Huang

摘要

Autonomous orbital pursuit–evasion represents a complex differential game with impulsive dynamics and stochastic adversarial maneuvers. Although model-free reinforcement learning has shown promise in high-dimensional decision-making, it often suffers from slow convergence and instability, mainly due to high-variance value estimation caused by unobservable evader maneuvers. This paper proposes a Physics-Informed Proximal Policy Optimization (PI-PPO) framework featuring a dual-correction closed-loop mechanism. A Kalman-driven opponent-modeling module dynamically estimates impulsive maneuvers, enabling accurate physical prediction under maneuvering uncertainty and correcting the systematic prediction bias of the orbital dynamics model. Furthermore, a physics-consistency loss derived from the Clohessy–Wiltshire equations is incorporated into the critic to regularize value learning and promote physical coherence. These two mechanisms establish a closed loop where data corrects physics and physics constrains learning, ensuring lower-variance and more stable policy updates. Simulation results in impulsive orbital pursuit scenarios demonstrate that the proposed method achieves faster convergence, higher sample efficiency, and stronger robustness against maneuver uncertainty compared with baseline algorithms.