Facial albedo generation for 3D face reconstruction from a single image via a coarse-to-fine approach
摘要
Facial albedo generation is a key component of relightable 3D face reconstruction from a single image. Existing methods either rely on low-dimensional texture models that miss high-frequency details or employ high-capacity image generation pipelines that may entangle facial reflectance with illumination effects. To address this gap, we propose an end-to-end coarse-to-fine framework for UV albedo generation. Our method first uses a UV Albedo Parametric Model (UVAPM), driven by low-dimensional coefficients, to generate coarse albedo maps with stable skin tones and low-frequency texture structure. It then refines the coarse result with a detail generator trained on decoupled albedo residuals to recover local facial details. Rather than targeting unconstrained image synthesis, the proposed framework is designed for controllable albedo estimation that is compatible with differentiable 3D face reconstruction. Experiments on three datasets show competitive qualitative and quantitative performance and improved recovery of facial details such as beards, wrinkles, and spots. The code and pre-trained model are publicly available at https://github.com/MVIC-DAI/UVAPM to support reproducibility and further research.