MMOTS: A Multi-UAV Pursuit-Evasion Game Training Strategy Relying on Offline Reinforcement Learning
摘要
Multiple unmanned aerial vehicles (UAVs) pursuit-evasion game is a prominent approach for achieving air superiority. In this paper, a multi-agent independent soft actor-critic (MAISAC) and multi-agent independent decision transformer (MAIDT)-based offline reinforcement learning training strategy (MMOTS) is proposed to train multiple UAVs to complete the pursuit-evasion game, encompassing a two-stage design. In the first stage, we develop the MAISAC algorithm to facilitate policy improvement and offline dataset generation. In the second stage, MAIDT is proposed to realize the model training and pursuit-evasion tasks. Finally, simulation results demonstrate that the proposed MMOTS can achieve pursuit success rate exceeding 70% when the target distance ranges from 6 to 8, and the number of pursuit UAVs ranges from two to four. These outcomes underscore the outstanding generality, scalability and performance of MMOTS in the context of multi-UAV pursuit-evasion games. To accelerate relevant research in this direction, the code for simulation will be released as open-source.