This paper introduces a unified theoretical perspective that views deep generative models as probability transformation functions. Despite the apparent differences in architecture and training methodologies among various types of generative models – autoencoders, autoregressive models, generative adversarial networks, normalizing flows, diffusion models, and flow matching – we demonstrate that they all fundamentally operate by transforming simple predefined distributions into complex target data distributions. This unifying perspective facilitates the transfer of methodological improvements between model architectures and provides a foundation for developing universal theoretical approaches, potentially leading to more efficient and effective generative modeling techniques.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Deep Generative Models as the Probability Transformation Functions

  • Vitalii Bondar,
  • Vira Babenko,
  • Roman Trembovetskyi,
  • Yurii Korobeinyk,
  • Viktoriya Dzyuba

摘要

This paper introduces a unified theoretical perspective that views deep generative models as probability transformation functions. Despite the apparent differences in architecture and training methodologies among various types of generative models – autoencoders, autoregressive models, generative adversarial networks, normalizing flows, diffusion models, and flow matching – we demonstrate that they all fundamentally operate by transforming simple predefined distributions into complex target data distributions. This unifying perspective facilitates the transfer of methodological improvements between model architectures and provides a foundation for developing universal theoretical approaches, potentially leading to more efficient and effective generative modeling techniques.