Vision-Based Indoor UAV Navigation with Deep Reinforcement Learning
摘要
The paper proposes a novel visual navigation framework to address the challenges encountered by unmanned aerial vehicles (UAVs) when operating in indoor environments, including insufficient image feature extraction and poor exploration. The framework utilizes depth images, flight state data, and relative orientation information to guide the UAV towards the intended destination in an end-to-end manner. In addition, we have designed a Convolutional Block Attention Module (CBAM) with a non-sparse reward mechanism to enhance the efficiency of visual feature extraction, thereby improving the UAV’s exploratory capabilities. We have deployed the algorithm in an AirSim-based simulation environment, characterized by ever-changing obstacles, to validate its effectiveness. The results demonstrate that our algorithm enables the UAV to avoid obstacles and reach the destination effectively in unfamiliar indoor environments. This solution has significant implications for the effective deployment of UAVs in indoor settings, particularly in applications such as search and rescue, inspection, and surveillance.