<p>This paper presents a real-time obstacle perception method (ROPM) for unmanned aerial vehicles (UAVs) with an RGB-D camera, which aims to address the difficulty of perceiving obstacles in real-time for UAVs in low-light environments. First of all, a novel obstacle detector is designed based on the ensemble detection strategy to rapidly detect dynamic and static obstacles in low-light environments. Moreover, a new tracker is constructed based on Kernel Correlation Filter (KCF), which uses the detection results to obtain obstacle features for regression matching. At the same time, a constant-acceleration Kalman filter is used to estimate the state of the dynamic obstacles in order to achieve the objective of constant and stable dynamic tracking. Furthermore, an obstacle reposition method in the region of obstacle tracking loss is designed, in order to address the problem of occlusion during obstacle perception in unknown low-light environments. Finally, extensive validation conducted in both indoor and outdoor under various lighting conditions proves the effectiveness of our proposed method for highly dynamic and low-light environments.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Real-time obstacle perception method for UAVs with an RGB-D camera in low-light environments

  • Hua Wang,
  • Hao Wang,
  • Yan-Jun Liu,
  • Lei Liu

摘要

This paper presents a real-time obstacle perception method (ROPM) for unmanned aerial vehicles (UAVs) with an RGB-D camera, which aims to address the difficulty of perceiving obstacles in real-time for UAVs in low-light environments. First of all, a novel obstacle detector is designed based on the ensemble detection strategy to rapidly detect dynamic and static obstacles in low-light environments. Moreover, a new tracker is constructed based on Kernel Correlation Filter (KCF), which uses the detection results to obtain obstacle features for regression matching. At the same time, a constant-acceleration Kalman filter is used to estimate the state of the dynamic obstacles in order to achieve the objective of constant and stable dynamic tracking. Furthermore, an obstacle reposition method in the region of obstacle tracking loss is designed, in order to address the problem of occlusion during obstacle perception in unknown low-light environments. Finally, extensive validation conducted in both indoor and outdoor under various lighting conditions proves the effectiveness of our proposed method for highly dynamic and low-light environments.