IDiff-NeRF: single-view 3D human body reconstruction utilizing identity-based diffusion within implicit neural network framework
摘要
Recently, efficiently learning a user-specific neural 3D body model for Novel view synthesis has drawn significant attention. However, existing neural human rendering methods struggle with a single-image input when large disparity captures are encountered. In this paper, we propose IDiff-NeRF, a novel framework for high-fidelity and plausible free-view human body synthesis exclusively from a single image. Our method builds a diffusible density volumetric representation to necessitate identity-based rendering drawing upon the diffusion model. Employing a parametric score to depict the 3D representation distribution, we strive to achieve Pareto optimality in the non-equilibrium optimization framework, balancing realistic rendering and feasible predictions.