<p>Image restoration and enhancement, e.g., image deblurring, deraining and low-light image enhancement (LLIE), aim to improve the visual quality according to the corrupted/low-quality observation. Deep learning-based methods have achieved remarkable results on these individual tasks, but it is still hard to tackle them together. While some attempts have been made to implement joint task processing, they inevitably lead to higher data cost and higher training cost. Moreover, these attempts are strictly limited by the data distribution, i.e., the distribution of the inference data is required to be as close as possible to the training data, otherwise the data cannot be used for inference. In this paper, we take the LLIE and deblurring task as the subjects in an attempt to seek a novel solution to the joint task processing problem. Specifically, we tackle this kind of problem in an extraordinary manner, i.e., individual/joint deblurring and low-light image enhancement in one go via unsupervised deblurring paradigm (DEvUDP), which integrates the noise self-regression and could avoid the limitations of aforementioned attempts. More specifically, a novel architecture with a transformation branch and a self-regression branch is elaborated, which only accepts unpaired blurry-sharp data as input to train the model; in this way, the pre-trained model can be surprisingly applied to both LLIE, deblurring and mixed degradation processing. Besides, we can choose to highlight perceptual performance or distortion performance of the model by configuring different components to the architecture. Extensive experiments have demonstrated the superiority of the method on different widely-used datasets.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Individual/joint deblurring and low-light image enhancement in one go via unsupervised deblurring paradigm

  • Suiyi Zhao,
  • Zhao Zhang,
  • Yanyan Wei,
  • Jicong Fan,
  • Yang Zhao,
  • Shuicheng Yan,
  • Meng Wang

摘要

Image restoration and enhancement, e.g., image deblurring, deraining and low-light image enhancement (LLIE), aim to improve the visual quality according to the corrupted/low-quality observation. Deep learning-based methods have achieved remarkable results on these individual tasks, but it is still hard to tackle them together. While some attempts have been made to implement joint task processing, they inevitably lead to higher data cost and higher training cost. Moreover, these attempts are strictly limited by the data distribution, i.e., the distribution of the inference data is required to be as close as possible to the training data, otherwise the data cannot be used for inference. In this paper, we take the LLIE and deblurring task as the subjects in an attempt to seek a novel solution to the joint task processing problem. Specifically, we tackle this kind of problem in an extraordinary manner, i.e., individual/joint deblurring and low-light image enhancement in one go via unsupervised deblurring paradigm (DEvUDP), which integrates the noise self-regression and could avoid the limitations of aforementioned attempts. More specifically, a novel architecture with a transformation branch and a self-regression branch is elaborated, which only accepts unpaired blurry-sharp data as input to train the model; in this way, the pre-trained model can be surprisingly applied to both LLIE, deblurring and mixed degradation processing. Besides, we can choose to highlight perceptual performance or distortion performance of the model by configuring different components to the architecture. Extensive experiments have demonstrated the superiority of the method on different widely-used datasets.