We introduce neural-code PIFu, a novel implicit function for 3D human reconstruction, leveraging neural codebooks, our approach learns recurrent patterns in the feature space and reuses them to improve current features. Many existing methods predict normal maps from image feature space which easily overlook non-trivial features. Moreover, neglecting global geometric correlations restricted the use of repetitive features to improve the expressive power of current features. In this work, we propose neural-code PIFu, a novel framework that enhances initial features by fusing them with neural codes that are learned from the input features and geometric prior. It also models the global geometric correlation to facilitate the use of neural codes. Extensive experiments demonstrate that our method outperforms state-of-the-art (SoTA) PIFu-based approaches by a large margin, and achieves comparable results to parametric-models-based methods without the use of auxiliary data.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Neural-Code PIFu: High-Fidelity Single Image 3D Human Reconstruction via Neural Code Integration

  • Ruizhi Liu,
  • Paolo Remagnino,
  • Hubert P. H. Shum

摘要

We introduce neural-code PIFu, a novel implicit function for 3D human reconstruction, leveraging neural codebooks, our approach learns recurrent patterns in the feature space and reuses them to improve current features. Many existing methods predict normal maps from image feature space which easily overlook non-trivial features. Moreover, neglecting global geometric correlations restricted the use of repetitive features to improve the expressive power of current features. In this work, we propose neural-code PIFu, a novel framework that enhances initial features by fusing them with neural codes that are learned from the input features and geometric prior. It also models the global geometric correlation to facilitate the use of neural codes. Extensive experiments demonstrate that our method outperforms state-of-the-art (SoTA) PIFu-based approaches by a large margin, and achieves comparable results to parametric-models-based methods without the use of auxiliary data.