Current single-view 3D human reconstruction methods primarily utilize the Skinned Multi-Person Linear Model (SMPL) to integrate structural priors but often neglect essential spatial and depth information. This oversight leads to issues such as fragmented or disembodied body parts and a lack of detail, arising from inadequate use of spatial data. To tackle these challenges, we introduce the Point-related Implicit Function (PrIF), a novel method for reconstructing dressed bodies using single-view RGBD input via an implicit function. Specifically, to address depth ambiguities, we suggest combining RGBD with the Pixel-aligned Implicit Function (PIFu). The RGBD-PIFu employs a fully convolutional RGBD image encoder alongside an implicit function. Within this framework, we develop an innovative point cloud-related implicit function reconstruction strategy to address problems with fragmented or incomplete body parts, incorporating point cloud feature extraction and a relative encoding strategy. Leveraging RGBD inputs allows for extensive utilization of the depth and spatial data of the point cloud, thus enhancing the sensitivity of the implicit function to spatial information. Experimental results show that our algorithm significantly surpasses state-of-the-art in single-view human reconstruction.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

PrIF: Point-Related Implicit Function for Single View Clothed Human Reconstruction

  • Yuan Gao,
  • Wei Yu,
  • Hui Gao

摘要

Current single-view 3D human reconstruction methods primarily utilize the Skinned Multi-Person Linear Model (SMPL) to integrate structural priors but often neglect essential spatial and depth information. This oversight leads to issues such as fragmented or disembodied body parts and a lack of detail, arising from inadequate use of spatial data. To tackle these challenges, we introduce the Point-related Implicit Function (PrIF), a novel method for reconstructing dressed bodies using single-view RGBD input via an implicit function. Specifically, to address depth ambiguities, we suggest combining RGBD with the Pixel-aligned Implicit Function (PIFu). The RGBD-PIFu employs a fully convolutional RGBD image encoder alongside an implicit function. Within this framework, we develop an innovative point cloud-related implicit function reconstruction strategy to address problems with fragmented or incomplete body parts, incorporating point cloud feature extraction and a relative encoding strategy. Leveraging RGBD inputs allows for extensive utilization of the depth and spatial data of the point cloud, thus enhancing the sensitivity of the implicit function to spatial information. Experimental results show that our algorithm significantly surpasses state-of-the-art in single-view human reconstruction.