Regularizing StyleGAN with Inter-resolution Residual Pattern Consistency via a Laplacian Pyramid
摘要
In image generation using StyleGAN2, which utilizes multiple layers corresponding to different resolutions, architectural flexibility allows higher-resolution layers to dominate the generation process. This may disrupt the functional hierarchy and lead to structural failures such as distorted faces or inconsistent layouts. We propose Residual Pattern Consistency (RPC), a lightweight regularization method that aligns each intermediate output with the corresponding frequency band from the Laplacian decomposition of the final output, encouraging resolution-specific generation without modifying the generator. We further introduce the Structural Consistency Score (SCS) to quantify the alignment between intermediate residuals and their expected roles. Experiments on the FFHQ, AFHQv2, and LSUN Church datasets show that RPC reduces Perceptual Path Length (PPL) and improves SCS, while incurring only a slight increase in Fréchet Inception Distance (FID). Qualitative results confirm that RPC notably reduces the frequency and severity of structural failures.