FreeForm-Prior: Parametric-Guided Model-Free 3D Human Mesh Reconstruction
摘要
Monocular 3D human mesh reconstruction remains challenging due to depth ambiguity and the trade-off between parametric prior reliance and model-free flexibility. While model-based methods provide kinematic stability yet encounter difficulties in detailed geometry, model-free approaches excel at detail recovery but often violate anatomical constraints. To bridge this gap, we propose a novel parametric prior-guided model-free framework that builds upon inverse kinematics and virtual marker theory, establishing a geometric alignment mechanism between parametric pose parameters and model-free keypoint predictions. First, we contribute a dual-branch architecture that synergizes SMPL parametric priors with model-free mesh regression to achieve robust estimation. Second, we develop a memory-efficient lifting-module based on full perspective projection. By combining 2D heatmap localization with transformer-based depth regression, it reduces memory consumption by 43.5% compared to conventional 3D heatmap methods. Third, we propose a multilevel loss function that jointly optimizes kinematic constraints and geometric alignment. Experiments show state-of-the-art performance on benchmarks (54.2 mm MPVE on H3.6M) and superior generalization on 3DPW, outperforming both model-based and model-free baselines. The dataset and codes will be available on the project homepage: https://github.com/ling-wuzmy/FreeForm-Prior .