Adaptive branch selection for accelerate image super-resolution
摘要
In practical applications, image resolution has already reached 4K. However, large images often contain many smooth regions that can achieve good performance using networks with fewer channels. Existing methods for accelerating SR models typically divide images into multiple patches and process them through separate branches. However, these approaches suffer from two limitations: (1) the lack of scalability to be developed on platforms with different capacities and (2) the lack of interaction between multiple branches results in limited acceleration performance. Based on this, we propose adaptive branch selection (ABS) for accelerating image super-resolution. ABS utilizes an efficient regressor to predict the performance increment between branches, dynamically selecting different branches for each patch by adjusting thresholds. To further enhance the acceleration performance, we introduce Progressive Mutual Information Knowledge Distillation (PMID) to help improve the SR performance of branches with fewer channels. Experimental results on the Test8K dataset show that FSRCNN-ABS achieves performance comparable to the original model while using only 49