<p>In most low-light RAW image enhancement methods, light intensity is amplified first, followed by denoising using deep networks or algorithms. However, noise in low-light environments has high-frequency characteristics and uneven distribution, leading to detail loss during denoising. By predicting noise, we can better distinguish between noise and details. In this paper, we propose a multi-task learning framework that jointly learns noise prediction and removal in an end-to-end manner, benefiting from the mutual enhancement between the tasks. Our framework integrates a noise prediction network into the exposure diffusion model. Compared to other denoising models, the diffusion model addresses content inconsistency in low-light images by incorporating stepwise diffusion and interaction between noise and details. Specifically, the low-light RAW image is passed through the noise prediction network to generate a residual map, which is then input into an interaction module to produce a denoising prior. This prior is fed into the exposure diffusion model for guided denoising, resulting in an image close to the ideal RAW image. Unlike traditional models that focus on noise diversity, our approach emphasizes discriminability in the diffusion process, making it more suitable for tasks requiring both diversity and precision. We achieved excellent results on the SID and ELD datasets.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Low-light image denoising with learnable diffusion prior

  • Longfei Han,
  • Mengzhen Wang

摘要

In most low-light RAW image enhancement methods, light intensity is amplified first, followed by denoising using deep networks or algorithms. However, noise in low-light environments has high-frequency characteristics and uneven distribution, leading to detail loss during denoising. By predicting noise, we can better distinguish between noise and details. In this paper, we propose a multi-task learning framework that jointly learns noise prediction and removal in an end-to-end manner, benefiting from the mutual enhancement between the tasks. Our framework integrates a noise prediction network into the exposure diffusion model. Compared to other denoising models, the diffusion model addresses content inconsistency in low-light images by incorporating stepwise diffusion and interaction between noise and details. Specifically, the low-light RAW image is passed through the noise prediction network to generate a residual map, which is then input into an interaction module to produce a denoising prior. This prior is fed into the exposure diffusion model for guided denoising, resulting in an image close to the ideal RAW image. Unlike traditional models that focus on noise diversity, our approach emphasizes discriminability in the diffusion process, making it more suitable for tasks requiring both diversity and precision. We achieved excellent results on the SID and ELD datasets.