<p>Computational dance generation is crucial in many areas, such as art, human-computer interaction, virtual reality, and digital entertainment, particularly for generating coherent and expressive long dance sequences. Diffusion-based music-to-dance generation has made significant progress, yet existing methods still struggle to produce physically plausible motions. To address this, we propose plausibility-aware motion diffusion (PAMD), a framework for generating dances that are both musically aligned and physically realistic. The core of PAMD lies in the plausible motion constraint (PMC), which leverages neural distance fields (NDFs) to model the actual pose manifold and to guide generated motions toward a physically valid pose manifold. To provide more effective guidance during generation, we incorporate prior motion guidance (PMG), which uses standing poses as auxiliary conditions alongside music features. To further enhance realism for complex movements, we introduce the contact-based motion refinement (CMR) module, which addresses foot-skating artifacts by bridging the gap between the optimization objective in linear joint position space and the data representation in nonlinear rotation space. Extensive experiments show that PAMD significantly improves musical alignment and enhances the physical plausibility of generated motions.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

PAMD: plausibility-aware motion diffusion model for long dance generation

  • Hongsong Wang,
  • Ying Zhu,
  • Qiuxia Lai,
  • Yang Zhang,
  • Guo-Sen Xie,
  • Xin Geng

摘要

Computational dance generation is crucial in many areas, such as art, human-computer interaction, virtual reality, and digital entertainment, particularly for generating coherent and expressive long dance sequences. Diffusion-based music-to-dance generation has made significant progress, yet existing methods still struggle to produce physically plausible motions. To address this, we propose plausibility-aware motion diffusion (PAMD), a framework for generating dances that are both musically aligned and physically realistic. The core of PAMD lies in the plausible motion constraint (PMC), which leverages neural distance fields (NDFs) to model the actual pose manifold and to guide generated motions toward a physically valid pose manifold. To provide more effective guidance during generation, we incorporate prior motion guidance (PMG), which uses standing poses as auxiliary conditions alongside music features. To further enhance realism for complex movements, we introduce the contact-based motion refinement (CMR) module, which addresses foot-skating artifacts by bridging the gap between the optimization objective in linear joint position space and the data representation in nonlinear rotation space. Extensive experiments show that PAMD significantly improves musical alignment and enhances the physical plausibility of generated motions.