Recently, diffusion models, with their powerful generative capabilities, have become one of the hot topics in generative models. Application areas include computer vision, speech generation, bioinformatics, and natural language processing. Diffusion probabilistic models were initially proposed as latent variable generative models inspired by non-equilibrium thermodynamics. These models consist of two processes: the forward process, which adds noise at multiple scales, gradually disturbing the data distribution; and the reverse process, which learns to recover the data structure. This chapter covers the theory and application of diffusion models. Section 16.1 discusses fraction-based generative networks with Langevin dynamics; Sect. 16.2 introduces denoising diffusion probabilistic models; Sect. 16.3 analyzes denoising diffusion implicit models (DDIMs); Sect. 16.4 discusses the SDE framework that encapsulates previous methods; Sect. 16.5 introduces the application of diffusion models in image and video synthesis; Sect. 16.6 discusses another application, image-to-image translation; Sect. 16.7 introduces the application of diffusion models in text-to-image/video generation; Sect. 16.8 introduces the application of diffusion models in policy and planning learning, Sect. 16.9 summarizes some improvements to diffusion models.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Diffusion Models

  • Yu Huang,
  • Zijiang Yang

摘要

Recently, diffusion models, with their powerful generative capabilities, have become one of the hot topics in generative models. Application areas include computer vision, speech generation, bioinformatics, and natural language processing. Diffusion probabilistic models were initially proposed as latent variable generative models inspired by non-equilibrium thermodynamics. These models consist of two processes: the forward process, which adds noise at multiple scales, gradually disturbing the data distribution; and the reverse process, which learns to recover the data structure. This chapter covers the theory and application of diffusion models. Section 16.1 discusses fraction-based generative networks with Langevin dynamics; Sect. 16.2 introduces denoising diffusion probabilistic models; Sect. 16.3 analyzes denoising diffusion implicit models (DDIMs); Sect. 16.4 discusses the SDE framework that encapsulates previous methods; Sect. 16.5 introduces the application of diffusion models in image and video synthesis; Sect. 16.6 discusses another application, image-to-image translation; Sect. 16.7 introduces the application of diffusion models in text-to-image/video generation; Sect. 16.8 introduces the application of diffusion models in policy and planning learning, Sect. 16.9 summarizes some improvements to diffusion models.