Generative modeling of natural images has seen significant progress, but large-scale foundation models raise concerns about environmental impact, privacy, and biases. This motivates investigating more efficient and interpretable generative models. This work proposes a simple latent parametric generative model focused on realistic face generation, a domain that has seen success with neural networks. The model uses a low-dimensional latent representation from a pre-trained autoencoder, and proceeds in two stages: (1) modeling the latent distribution as a mixture of multivariate Gaussians trained on a limited dataset, and (2) generating low-rank random codes from this prior and remapping them using nearest nneighbor matching. Comparative experiments demonstrate the advantages of the proposed approach.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Low Rank Gaussian Mixture Latent Model for Face Generation

  • Benjamin Samuth,
  • Julien Rabin,
  • Fréderic Jurie,
  • David Tschumperlé

摘要

Generative modeling of natural images has seen significant progress, but large-scale foundation models raise concerns about environmental impact, privacy, and biases. This motivates investigating more efficient and interpretable generative models. This work proposes a simple latent parametric generative model focused on realistic face generation, a domain that has seen success with neural networks. The model uses a low-dimensional latent representation from a pre-trained autoencoder, and proceeds in two stages: (1) modeling the latent distribution as a mixture of multivariate Gaussians trained on a limited dataset, and (2) generating low-rank random codes from this prior and remapping them using nearest nneighbor matching. Comparative experiments demonstrate the advantages of the proposed approach.