As the use of UAVs becomes more prevalent, there is a growing need for increased autonomy. In this paper, we propose a robust collision avoidance method based on deep reinforcement learning in an unknown narrow corridor environment. In particular, we consider corridor environments with widths constrained to 1.6 times the UAV’s wingspan, making it difficult for the UAV to avoid obstacles. The proposed method is based on end-to-end control pattern, which takes airborne LiDAR measurements combined with the UAV state and destination information as inputs, and generates UAV control commands directly. Besides, we present the design of the deep reinforcement learning network and policy update strategy based on the PPO algorithm. In addition, we conduct extensive experimental validation both in 2D Stage scene and 3D Gazebo scene with external disturbance. The experimental results demonstrate that our method achieves robust and successful obstacle avoidance.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Robust Obstacle Avoidance for UAVs in Narrow Corridor Environment Based on Deep Reinforcement Learning

  • Ruiqi Feng,
  • Minfang Lu,
  • Zhihong Liu

摘要

As the use of UAVs becomes more prevalent, there is a growing need for increased autonomy. In this paper, we propose a robust collision avoidance method based on deep reinforcement learning in an unknown narrow corridor environment. In particular, we consider corridor environments with widths constrained to 1.6 times the UAV’s wingspan, making it difficult for the UAV to avoid obstacles. The proposed method is based on end-to-end control pattern, which takes airborne LiDAR measurements combined with the UAV state and destination information as inputs, and generates UAV control commands directly. Besides, we present the design of the deep reinforcement learning network and policy update strategy based on the PPO algorithm. In addition, we conduct extensive experimental validation both in 2D Stage scene and 3D Gazebo scene with external disturbance. The experimental results demonstrate that our method achieves robust and successful obstacle avoidance.