<p>Visual odometry is pivotal in robotics and autonomous driving, serving as a key component of visual simultaneous localization and mapping technology. In real-world scenarios, humans in local low-light conditions perceive less information, which can impact our judgments and actions. Similarly, visual odometry can become confused under these conditions, leading to compromised performance. To address the challenges posed by local low-light images on monocular visual odometry, we propose an unsupervised framework for monocular visual odometry. To the best of our knowledge, this is the first instance of unsupervised monocular visual odometry and local low-light image enhancement accomplished within a unified framework. Initially, we employ retinex theory and the discrete Fourier transform to decompose, filter, and synthesize the original image. For the filtering process, we propose a novel learnable global filtering network. Subsequently, we input the enhanced images into the depth and pose networks, generating the corresponding depth maps and inter-frame poses. Ultimately, we construct a photometric consistency loss, a depth loss, and a novel low-light smoothness loss to train the entire network. Through experimental validation, our method exhibits superior performance on the KITTI dataset. Furthermore, it demonstrates satisfactory generalization ability in unseen environments from the Oxford RobotCar dataset.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Perceptual Enhancement for Unsupervised Monocular Visual Odometry

  • Zhongyi Wang,
  • Mengjiao Shen,
  • Chengju Liu,
  • Qijun Chen

摘要

Visual odometry is pivotal in robotics and autonomous driving, serving as a key component of visual simultaneous localization and mapping technology. In real-world scenarios, humans in local low-light conditions perceive less information, which can impact our judgments and actions. Similarly, visual odometry can become confused under these conditions, leading to compromised performance. To address the challenges posed by local low-light images on monocular visual odometry, we propose an unsupervised framework for monocular visual odometry. To the best of our knowledge, this is the first instance of unsupervised monocular visual odometry and local low-light image enhancement accomplished within a unified framework. Initially, we employ retinex theory and the discrete Fourier transform to decompose, filter, and synthesize the original image. For the filtering process, we propose a novel learnable global filtering network. Subsequently, we input the enhanced images into the depth and pose networks, generating the corresponding depth maps and inter-frame poses. Ultimately, we construct a photometric consistency loss, a depth loss, and a novel low-light smoothness loss to train the entire network. Through experimental validation, our method exhibits superior performance on the KITTI dataset. Furthermore, it demonstrates satisfactory generalization ability in unseen environments from the Oxford RobotCar dataset.