Diffusion-based generative models for speech enhancement often face challenges in balancing performance and inference efficiency. We propose a Velocity-guided Interpolant Diffusion Model for Speech Enhancement (VISE), which incorporates three key innovations: a scalable interpolant framework that reconstructs the reverse diffusion process using velocity terms and state variables, a loss function designed to fit the velocity terms for efficient data distribution learning, and a combined SDE/ODE sampling strategy with an optional corrector. Experiments on VoiceBank-DEMAND and WSJ0-CHiME3 datasets show that our VISE significantly outperforms baselines across multiple metrics, particularly in noise separation with SI-SIR improvements of up to 4.7 dB. Moreover, its inference efficiency is up to 7 \(\times \) faster than existing diffusion-based methods while maintaining excellent enhancement performance.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

VISE: Velocity-Guided Interpolant Diffusion for Efficient Speech Enhancement

  • Gang Yang,
  • Yangjie Wei,
  • Ben Niu,
  • Yuqiao Wang,
  • Shengling Yu

摘要

Diffusion-based generative models for speech enhancement often face challenges in balancing performance and inference efficiency. We propose a Velocity-guided Interpolant Diffusion Model for Speech Enhancement (VISE), which incorporates three key innovations: a scalable interpolant framework that reconstructs the reverse diffusion process using velocity terms and state variables, a loss function designed to fit the velocity terms for efficient data distribution learning, and a combined SDE/ODE sampling strategy with an optional corrector. Experiments on VoiceBank-DEMAND and WSJ0-CHiME3 datasets show that our VISE significantly outperforms baselines across multiple metrics, particularly in noise separation with SI-SIR improvements of up to 4.7 dB. Moreover, its inference efficiency is up to 7 \(\times \) faster than existing diffusion-based methods while maintaining excellent enhancement performance.