Generative models hold great potential in various applications, such as anomaly detection, image-to-image translation, super-res-olution, and denoising. However, their complexity can make implementation and reproducibility challenging, hindering progress, creating barriers to adoption, and discouraging comparisons with existing methods. In this work, we propose a lightweight diffusion architecture with a simplified sampling procedure. We input the noise multiplier directly into the model rather than the timestep t. This design aims to balance computational cost and performance. We investigate how various parameters and architectural blocks impact generation quality, specifically measured using the Fréchet Inception Distance (FID). The proposed architecture is evaluated on two distinct tasks: face generation and super-resolution using the CelebA dataset. Our results demonstrate that the architecture achieves promising performance across these tasks, making it a viable option for scenarios requiring a compact model. We provide the related architecture and training code at https://github.com/mgp123/diffusion-learning .

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Lightweight Diffusion Model with Modified Sampler

  • Matias Grynberg Portnoy,
  • Emmanuel Ovalle-Magallanes

摘要

Generative models hold great potential in various applications, such as anomaly detection, image-to-image translation, super-res-olution, and denoising. However, their complexity can make implementation and reproducibility challenging, hindering progress, creating barriers to adoption, and discouraging comparisons with existing methods. In this work, we propose a lightweight diffusion architecture with a simplified sampling procedure. We input the noise multiplier directly into the model rather than the timestep t. This design aims to balance computational cost and performance. We investigate how various parameters and architectural blocks impact generation quality, specifically measured using the Fréchet Inception Distance (FID). The proposed architecture is evaluated on two distinct tasks: face generation and super-resolution using the CelebA dataset. Our results demonstrate that the architecture achieves promising performance across these tasks, making it a viable option for scenarios requiring a compact model. We provide the related architecture and training code at https://github.com/mgp123/diffusion-learning .