AFDiT: flow-guided transformer diffusion for structure-aware virtual try-on
摘要
Virtual try-on aims to generate photorealistic images of a person wearing a target garment, requiring precise garment–body alignment, fine-grained texture preservation, and robustness to pose variations. We propose AFDiT, a structure-aware virtual try-on framework that integrates appearance flow estimation with transformer-based diffusion generation. Specifically, we design an appearance flow encoder–decoder to predict dense garment deformation and alignment, and a parsing-guided mask fusion strategy to refine inpainting regions while preserving uncovered body parts. For high-quality synthesis, we introduce a warped garment-guided stable diffusion pipeline, injecting garment-specific CLIP embeddings and flow-guided warped garment features into a transformer-based diffusion model. Extensive experiments on VITON-HD demonstrate that AFDiT outperforms state-of-the-art methods in both paired and unpaired settings, achieving superior alignment, realism, and generalization to diverse poses and garments. The code is available at: https://github.com/MTKSHU/AFDiT.