Lightweight image super-resolution based on retentive network
摘要
Recent advancements have demonstrated the effectiveness of retentive networks in natural language processing and high-level vision tasks. However, their potential in low-level vision, such as image super-resolution (SR), remains underexplored. In this paper, we introduce RetNetSR, a novel retentive network architecture designed specifically for image super-resolution. Our approach leverages a spatial prior derived from the Manhattan distance to enhance the Self-Attention mechanism, effectively translating the temporal decay concept of RetNet into the spatial domain. At the core of RetNetSR is the Manhattan Self-Attention module, which integrates Self-Attention with multi-layer perceptrons and depthwise convolution. Building on this, we propose the Manhattan Self-Attention Block and the Manhattan Self-Attention Group, the latter further enriched with 3