Deep Diffusion Probabilistic Models (DDPMs) are a versatile class of generative models able to efficiently model complex data distributions and have quickly become challenging benchmarks for density estimation tasks. In this work, we present a neat solution to implement DDPMs for image generation using a compact TinyUNet architecture as well as diffusion-based sampling methods on probability modeling. The Fashion MNIST dataset is the canonical training data used for our model, which leverages a back propagation-based loss minimization algorithm implemented using TensorFlow to iteratively optimize encoder/decoder parameters so as to minimize Mean Squared Error between predicted noise and ground truth noise. We comprehensively evaluate and compare our method to demonstrate its effectiveness for synthesis of high-quality images with different visual attributes. In addition, we offer insights into how the DDPM framework operates, demonstrating model architecture interpretability and scalability. Our work is a good snapshot in the much larger context of generative modeling techniques and will provide clues for this type to scale further.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Denoising Diffusion Probabilistic Model with Fashion MNIST

  • Palak Singh,
  • Pratyush Priyam,
  • Ayush Yadav,
  • Aaron Issac Abraham,
  • Sudeshna Datta,
  • Nimish Singh,
  • Pranjal Kumar

摘要

Deep Diffusion Probabilistic Models (DDPMs) are a versatile class of generative models able to efficiently model complex data distributions and have quickly become challenging benchmarks for density estimation tasks. In this work, we present a neat solution to implement DDPMs for image generation using a compact TinyUNet architecture as well as diffusion-based sampling methods on probability modeling. The Fashion MNIST dataset is the canonical training data used for our model, which leverages a back propagation-based loss minimization algorithm implemented using TensorFlow to iteratively optimize encoder/decoder parameters so as to minimize Mean Squared Error between predicted noise and ground truth noise. We comprehensively evaluate and compare our method to demonstrate its effectiveness for synthesis of high-quality images with different visual attributes. In addition, we offer insights into how the DDPM framework operates, demonstrating model architecture interpretability and scalability. Our work is a good snapshot in the much larger context of generative modeling techniques and will provide clues for this type to scale further.