<p>Catadioptric omnidirectional cameras offer a 360<InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(^\circ \)</EquationSource> <EquationSource Format="MATHML"><math> <mmultiscripts> <mrow /> <mrow /> <mo>∘</mo> </mmultiscripts> </math></EquationSource> </InlineEquation> horizontal field of view but suffer from low image resolution. Image super-resolution (SR) techniques provide an effective solution to enhance image quality without upgrading hardware. This paper proposes a general framework based on deep learning to address the SR of catadioptric omnidirectional images. We first design a cylindrical projection model to transform the data structure of catadioptric images, enabling precise pixel-level projection. Based on this model, we generate two datasets: one for standard training (COCP-SR) and another for distortion correction training (SIM-SR). We then propose a dedicated SR network, COSISR, incorporating a Distortion Feature Extraction Block and two latitude-adaptive modules. COSISR learns multidimensional distortion features and achieves state-of-the-art SR performance. Here, we show that COSISR outperforms existing SR algorithms, with gains of over 1 dB in PSNR for <InlineEquation ID="IEq2"> <EquationSource Format="TEX">\(\times \)</EquationSource> <EquationSource Format="MATHML"><math> <mo>×</mo> </math></EquationSource> </InlineEquation>2 SR and over 0.45 dB for <InlineEquation ID="IEq3"> <EquationSource Format="TEX">\(\times \)</EquationSource> <EquationSource Format="MATHML"><math> <mo>×</mo> </math></EquationSource> </InlineEquation>4 SR. This work significantly improves the resolution and visual fidelity of catadioptric omnidirectional images, broadening their application in fields such as 3D scene reconstruction and visual navigation. The relevant data and code are published in <a href="https://github.com/Flower-h/COSISR">https://github.com/Flower-h/COSISR</a>.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Adaptive super-resolution framework for catadioptric omnidirectional images via cylindrical projection and latitude-aware networks

  • Jiaxu Zhang,
  • Yaowen Lv,
  • Yuxuan Wang,
  • Xu Zhu,
  • Yiming Hu

摘要

Catadioptric omnidirectional cameras offer a 360 \(^\circ \) horizontal field of view but suffer from low image resolution. Image super-resolution (SR) techniques provide an effective solution to enhance image quality without upgrading hardware. This paper proposes a general framework based on deep learning to address the SR of catadioptric omnidirectional images. We first design a cylindrical projection model to transform the data structure of catadioptric images, enabling precise pixel-level projection. Based on this model, we generate two datasets: one for standard training (COCP-SR) and another for distortion correction training (SIM-SR). We then propose a dedicated SR network, COSISR, incorporating a Distortion Feature Extraction Block and two latitude-adaptive modules. COSISR learns multidimensional distortion features and achieves state-of-the-art SR performance. Here, we show that COSISR outperforms existing SR algorithms, with gains of over 1 dB in PSNR for \(\times \) × 2 SR and over 0.45 dB for \(\times \) × 4 SR. This work significantly improves the resolution and visual fidelity of catadioptric omnidirectional images, broadening their application in fields such as 3D scene reconstruction and visual navigation. The relevant data and code are published in https://github.com/Flower-h/COSISR.