High dynamic range (HDR) imaging aims to reconstruct ghost-free and detail-rich HDR images from multiple low dynamic range (LDR) images. Challenges such as exposure saturation and significant motion in the LDR image sequence can result in quality issues like ghosting, blurring, and distortion in the final synthesized image. To address these challenges, we present a new approach called Multi-Scale Progressive Reconstruction Network (MPRNet). The network consists of an encoder-decoder, Multi-Scale Progressive Reconstruction Module (MSPRM), and Dual-Stream Reconstruction Module (DERM). MSPRM utilizes a feature pyramid to tackle large-scale motions gradually. It incorporates an attention mechanism and scale selection module to progressively refine motion information within and across scales. DERM adopts a symmetric dual-stream structure to concurrently perform exposure recovery and content reconstruction. It guides the fine-grained restoration of overexposed regions through a joint loss function. The experimental results indicate that the MPRNet fusion results outperform the dominant models in qualitative and quantitative assessments, especially in accurately representing exposure-saturated regions, preserving non-aligned edge details, and maintaining color fidelity.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Multi-scale Progressive Reconstruction Network for High Dynamic Range Imaging

  • Ying Qi,
  • Qiushi Li,
  • Jian Li,
  • Zhaoyuan Huang,
  • Teng Wan,
  • Qiang Zhang

摘要

High dynamic range (HDR) imaging aims to reconstruct ghost-free and detail-rich HDR images from multiple low dynamic range (LDR) images. Challenges such as exposure saturation and significant motion in the LDR image sequence can result in quality issues like ghosting, blurring, and distortion in the final synthesized image. To address these challenges, we present a new approach called Multi-Scale Progressive Reconstruction Network (MPRNet). The network consists of an encoder-decoder, Multi-Scale Progressive Reconstruction Module (MSPRM), and Dual-Stream Reconstruction Module (DERM). MSPRM utilizes a feature pyramid to tackle large-scale motions gradually. It incorporates an attention mechanism and scale selection module to progressively refine motion information within and across scales. DERM adopts a symmetric dual-stream structure to concurrently perform exposure recovery and content reconstruction. It guides the fine-grained restoration of overexposed regions through a joint loss function. The experimental results indicate that the MPRNet fusion results outperform the dominant models in qualitative and quantitative assessments, especially in accurately representing exposure-saturated regions, preserving non-aligned edge details, and maintaining color fidelity.