<p>Early detection of developmental disorders can be aided by analyzing infant craniofacial morphology, but modeling infant faces is challenging due to limited data and frequent spontaneous expressions. We introduce BabyFlow, a generative AI model that disentangles facial identity and expression, enabling independent control over both. Using normalizing flows, BabyFlow learns flexible, probabilistic representations that capture the complex, non-linear variability of expressive infant faces without restrictive linear assumptions. To address scarce and uncontrolled expressive data, we perform cross-age expression transfer, adapting expressions from adult 3D scans to enrich infant datasets with realistic and systematic expressive variants. As a result, BabyFlow improves 3D reconstruction accuracy, particularly in highly expressive regions such as the mouth, eyes, and nose, and supports synthesis and modification of infant expressions while preserving identity. However, the current model is trained on a relatively small cohort of craniofacially unaffected infants, which may limit generalization to pathological morphologies. Additionally, integrating BabyFlow with diffusion models offers a promising direction for data synthesis, as it could serve as a conditioning mechanism for generating expressive and realistic 2D infant images. Further evaluation is needed to assess image realism, 3D-2D geometric consistency, robustness, and potential ethical and bias-related concerns.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

BabyFlow: 3D modeling of realistic and expressive infant faces

  • Antonia Alomar,
  • Mireia Masias,
  • Marius George Linguraru,
  • Federico M. Sukno,
  • Gemma Piella

摘要

Early detection of developmental disorders can be aided by analyzing infant craniofacial morphology, but modeling infant faces is challenging due to limited data and frequent spontaneous expressions. We introduce BabyFlow, a generative AI model that disentangles facial identity and expression, enabling independent control over both. Using normalizing flows, BabyFlow learns flexible, probabilistic representations that capture the complex, non-linear variability of expressive infant faces without restrictive linear assumptions. To address scarce and uncontrolled expressive data, we perform cross-age expression transfer, adapting expressions from adult 3D scans to enrich infant datasets with realistic and systematic expressive variants. As a result, BabyFlow improves 3D reconstruction accuracy, particularly in highly expressive regions such as the mouth, eyes, and nose, and supports synthesis and modification of infant expressions while preserving identity. However, the current model is trained on a relatively small cohort of craniofacially unaffected infants, which may limit generalization to pathological morphologies. Additionally, integrating BabyFlow with diffusion models offers a promising direction for data synthesis, as it could serve as a conditioning mechanism for generating expressive and realistic 2D infant images. Further evaluation is needed to assess image realism, 3D-2D geometric consistency, robustness, and potential ethical and bias-related concerns.