High accurate SMPL-X generation based on volumetric reconstruction
摘要
Recent research on accurately generating human bodies, such as SMPL-X, for human motion and expression has gained momentum. However, traditional 2D image-based methods for generating human body models inevitably face limitations, such as depth ambiguity. This paper proposes a method that accurately generates human bodies, like SMPL or SMPL-X, using 3D volumetric data. Since 3D volumetric data contains precise spatial information, we leverage it to estimate SMPL-X joints accurately and reconstruct the SMPL-X model from them. The proposed method extracts 2D key points from multi-view images projected from 3D volumetric data and generates an accurate human body model through confidence-based 3D reconstruction. By applying this method, we can generate body models with a mean per-joint position error (MPJPE) of about 50 mm, resolving the depth ambiguity issue. Additionally, by fitting 3D volumetric data to human mesh models, we effectively utilize the rich depth information to overcome challenges such as depth ambiguity.