Accurate object pose estimation is crucial for various computer vision applications, such as human-robot interaction, augmented reality, embodied intelligence and autonomous driving. Existing methods often rely on predefined object models and categories, which can be impractical for real-world deployment. To address this challenges, this paper proposes a novel one-shot 6D pose estimation method based on multi-scale feature fusion and 3D Gaussian Splatting (3DGS) refinement. This method innovatively reconstructs the point cloud and 3D Gaussian representation of the object with integrating Structure from Motion (SfM) technology and multi-view information. A novel multi-scale feature matching fusion network is designed to effectively enhance the correspondence between images and point clouds. A 6D pose refinement module based on 3D Gaussian Splatting is proposed to improve the pose estimation accuracy. Extensive experiments and ablations conducted on LINEMOD dataset and OnePose-LowTexture dataset firmly establish the state-of-the-art performance of the proposed approach in the context of 6D object pose estimation.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

6DMFGS: Accurate One-shot 6D Pose Estimation via Multi-scale Feature Fusion and 3D Gaussian Splatting

  • Xiangyu Liu,
  • Haotian Lei,
  • Guo Niu,
  • Suwei Ye,
  • Lanxiang Zheng,
  • Jianqi Liu,
  • Yuexia Zhou,
  • Fuhe Liu,
  • Yuankang Lv,
  • Yanhan Gu

摘要

Accurate object pose estimation is crucial for various computer vision applications, such as human-robot interaction, augmented reality, embodied intelligence and autonomous driving. Existing methods often rely on predefined object models and categories, which can be impractical for real-world deployment. To address this challenges, this paper proposes a novel one-shot 6D pose estimation method based on multi-scale feature fusion and 3D Gaussian Splatting (3DGS) refinement. This method innovatively reconstructs the point cloud and 3D Gaussian representation of the object with integrating Structure from Motion (SfM) technology and multi-view information. A novel multi-scale feature matching fusion network is designed to effectively enhance the correspondence between images and point clouds. A 6D pose refinement module based on 3D Gaussian Splatting is proposed to improve the pose estimation accuracy. Extensive experiments and ablations conducted on LINEMOD dataset and OnePose-LowTexture dataset firmly establish the state-of-the-art performance of the proposed approach in the context of 6D object pose estimation.