Zero-shot image super-resolution using prompt-driven vision-language foundation models without task-specific fine-tuning
摘要
The paper introduces a new method for image super-resolution (SR) using a prompt-guided, zero-shot framework that leverages the capabilities of vision-language foundation models (VLFMs) and generative diffusion models. Unlike traditional SR models requiring paired low and high-resolution images, this approach uses natural language prompts to enhance images without needing paired data. VLFMs like BLIP help create strong representations by connecting low-resolution images with various texts. The framework employs static and dynamic prompt techniques to adapt to different image contexts and user needs. Tests on datasets such as DIV2K confirm its effectiveness, showing it achieves performance on par with or better than conventional methods.