<p>Despite the significant progress achieved by image deblurring prevalent techniques, the great dilemma between computational efficiency enhancement and long-range degradation perturbation’s elimination still persists, due to the large discrepancy between the degraded/sharp image pairs spectra. While some deep learning approaches adopt multi-scale algorithms to implement coarse-to-fine scheme, which for deep semantics and low-scale RGB images feature fusion imposes complex modules, others seek solutions strictly in the frequency domain by utilizing transformation tools such as discrete Fourier/wavelet transform, which unfortunately is not optimally flexible to recover the most informative frequency component. To address this issue, we exhibit a novel image deblurring multi-scale adaptive frequency time-distribution paradigm principally based on single input (although the architecture equally admits multiple inputs) and multiple outputs. Specifically, to efficiently handle frequency-specific blur patterns, we impose a content-adaptive and dual-branch block which leverages a frequency-domain attention aggregated to spatial attention for dynamic features decomposition into multiple frequency bands. Moreover, to handle temporal consistency, we propose a module which computes optical flow between frames based on learned attention weights. Nonetheless, fine-grained feature adjustment is guaranteed as we offer an adaptive feature norm which provides dynamic feature normalization by feature calibration. In fine, our proposed AFTNet performs favourably against state-of-the-art algorithms on multiple real-world and synthetic deblurred datasets, in terms of both computational efficiency and objective and subjective quality. Our code is available on (<a href="https://github.com/voxtranslate/AFTNet">https://github.com/voxtranslate/AFTNet</a>).</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Adaptive frequency time-distribution network—a multiscale deblurring technique

  • Vivien Beyala Kamgang,
  • Perrin Li Litet,
  • Narcisse Tankam Talla,
  • Jaurès Fotsa-Mbogne,
  • Julius Marcellin Nkenlifack

摘要

Despite the significant progress achieved by image deblurring prevalent techniques, the great dilemma between computational efficiency enhancement and long-range degradation perturbation’s elimination still persists, due to the large discrepancy between the degraded/sharp image pairs spectra. While some deep learning approaches adopt multi-scale algorithms to implement coarse-to-fine scheme, which for deep semantics and low-scale RGB images feature fusion imposes complex modules, others seek solutions strictly in the frequency domain by utilizing transformation tools such as discrete Fourier/wavelet transform, which unfortunately is not optimally flexible to recover the most informative frequency component. To address this issue, we exhibit a novel image deblurring multi-scale adaptive frequency time-distribution paradigm principally based on single input (although the architecture equally admits multiple inputs) and multiple outputs. Specifically, to efficiently handle frequency-specific blur patterns, we impose a content-adaptive and dual-branch block which leverages a frequency-domain attention aggregated to spatial attention for dynamic features decomposition into multiple frequency bands. Moreover, to handle temporal consistency, we propose a module which computes optical flow between frames based on learned attention weights. Nonetheless, fine-grained feature adjustment is guaranteed as we offer an adaptive feature norm which provides dynamic feature normalization by feature calibration. In fine, our proposed AFTNet performs favourably against state-of-the-art algorithms on multiple real-world and synthetic deblurred datasets, in terms of both computational efficiency and objective and subjective quality. Our code is available on (https://github.com/voxtranslate/AFTNet).