WaveUIR: wavelet-based guided transformer model for efficient universal image restoration
摘要
Recently, various universal image restoration methods have achieved notable success, employing a single model to handle distinct unknown degradations. However, most of these methods require a significant number of model parameters and computational resources to learn the correlations among multiple degradations. Inspired by the efficient parameter learning methods based on wavelet transform, this paper designs a simple wavelet-based guided transformer model for efficient universal image restoration. First, we utilize wavelet subbands to guide up-and-down sampling and frequency-aware degradation-specific feature aggregation. Then, we send the decomposed high-frequency components to a classifier designed for getting degradation weights. These weights can be used to guide the filtering of detail coefficients along with high-frequency components. Finally, we adaptively aggregate the processed high- and low-frequency components, effectively producing degradation-specific information for universal image restoration. Extensive experiments show the superior performance of the proposed WaveUIR, achieving state-of-the-art (SOTA) performance with 88.16% decrease in model parameters and 77.15% reduction in computational resources compared to previous SOTA method. The code is available at https://github.com/Archaic-Atom/WaveUIR.