We propose a novel probabilistic direct structure-from-motion (SfM) method that combines black-box variational inference (BBVI) with the reparameterization trick. Unlike conventional approaches that rely on infinitesimal motion approximations and linearization, our method directly optimizes the nonlinear perspective projection model, achieving robust estimation even under large camera motions. By leveraging automatic differentiation, the BBVI formulation provides efficient, low-variance gradient estimation compared to REINFORCE-based methods. A hierarchical multi-resolution scheme further enhances stability and maintains implementation simplicity. Experimental results demonstrate that our approach successfully handles challenging wide-baseline scenarios while providing reliable, uncertainty-aware depth estimation.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Probabilistic Direct Structure from Motion via Hierarchical Reparameterization Trick

  • Yushan Wang,
  • Norio Tagawa

摘要

We propose a novel probabilistic direct structure-from-motion (SfM) method that combines black-box variational inference (BBVI) with the reparameterization trick. Unlike conventional approaches that rely on infinitesimal motion approximations and linearization, our method directly optimizes the nonlinear perspective projection model, achieving robust estimation even under large camera motions. By leveraging automatic differentiation, the BBVI formulation provides efficient, low-variance gradient estimation compared to REINFORCE-based methods. A hierarchical multi-resolution scheme further enhances stability and maintains implementation simplicity. Experimental results demonstrate that our approach successfully handles challenging wide-baseline scenarios while providing reliable, uncertainty-aware depth estimation.