Scholarlink

<p>Talking head generation (THG) has emerged as a transformative technology in computer vision, synthesizing realistic human faces synchronized with audio, image, text, or video inputs. This paper systematically reviews THG methodologies and frameworks, categorizing approaches into 2D-based, 3D-based, Neural Radiance Fields (NeRF)-based, diffusion-based, and other techniques. We explore the most effective approaches in THG, emphasizing training techniques that improve realism, identity preservation, and motion accuracy. THG has vast potential applications, including creating digital avatars, dubbing videos, enhancing virtual assistants, and improving video calls. However, challenges include needing large models, handling extreme head movements, maintaining language synchronicity, and ensuring smooth visuals persist. This review provides a comprehensive overview of current progress, identifies ongoing challenges, and suggests future research directions, including developing simpler and more adaptable models, enabling real-time processing on smaller devices, and creating ethical guidelines. By summarizing existing research and highlighting ongoing challenges, this overview offers valuable insights for anyone interested in future of talking head technology. For the complete survey, code, and curated resource list, visit our GitHub repository: <a href="https://github.com/VineetKumarRakesh/thg.">https://github.com/VineetKumarRakesh/thg.</a></p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

Advancements in talking head generation: a comprehensive review of techniques, metrics, and challenges

  • 期刊论文

  • 出版模式：

    开放获取

  • 发表日期：

    2025年12月4日

查看全文
  • Vineet Kumar Rakesh,
  • Soumya Mazumdar,
  • Research Pratim Maity,
  • Sarbajit Pal,
  • Amitabha Das,
  • Tapas Samanta

摘要

Talking head generation (THG) has emerged as a transformative technology in computer vision, synthesizing realistic human faces synchronized with audio, image, text, or video inputs. This paper systematically reviews THG methodologies and frameworks, categorizing approaches into 2D-based, 3D-based, Neural Radiance Fields (NeRF)-based, diffusion-based, and other techniques. We explore the most effective approaches in THG, emphasizing training techniques that improve realism, identity preservation, and motion accuracy. THG has vast potential applications, including creating digital avatars, dubbing videos, enhancing virtual assistants, and improving video calls. However, challenges include needing large models, handling extreme head movements, maintaining language synchronicity, and ensuring smooth visuals persist. This review provides a comprehensive overview of current progress, identifies ongoing challenges, and suggests future research directions, including developing simpler and more adaptable models, enabling real-time processing on smaller devices, and creating ethical guidelines. By summarizing existing research and highlighting ongoing challenges, this overview offers valuable insights for anyone interested in future of talking head technology. For the complete survey, code, and curated resource list, visit our GitHub repository: https://github.com/VineetKumarRakesh/thg.