Light field spatial super-resolution (LFSSR) relies on the comprehensive complementarity of 4D information. Existing CNN-based methods suffer from limited receptive field, while Transformer-based approaches incur prohibitive quadratic computational complexity. Although recent Mamba-based methods can model global dependency with linear complexity, the sequential scanning mechanism of Mamba inherently disrupts the intrinsic 4D local dependency of the light field image. Moreover, most of them encode the subspaces of light field in a decoupled manner, lacking explicit holistic modeling. In this paper, we propose LF Omnidirectional Mamba (LFOmniMamba) to address these challenges through two key components. First, the Domain-Enhanced Mamba (DEMamba) preserves and enhances local 4D consistency when processing light field subspaces via its internally integrated LF Neighbor-Guided Block. Second, the Pseudo-4D Mamba (P4DMamba) achieves efficient holistic global feature refinement through multi-scale 4D Mamba modeling. Building upon LFOmniMamba, we further propose LFOmniSR for comprehensive 4D feature extraction in LFSSR. Extensive benchmark experiments demonstrate that LFOmniSR outperforms state-of-the-art methods.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Enhancing 4D Consistency for Mamba-Based Light Field Spatial Super-Resolution

  • Yu Wang,
  • Ruixuan Cong,
  • Zexin Sun,
  • Da Yang,
  • Zhenglong Cui,
  • Siyang Li,
  • Shuai Wang,
  • Hao Sheng

摘要

Light field spatial super-resolution (LFSSR) relies on the comprehensive complementarity of 4D information. Existing CNN-based methods suffer from limited receptive field, while Transformer-based approaches incur prohibitive quadratic computational complexity. Although recent Mamba-based methods can model global dependency with linear complexity, the sequential scanning mechanism of Mamba inherently disrupts the intrinsic 4D local dependency of the light field image. Moreover, most of them encode the subspaces of light field in a decoupled manner, lacking explicit holistic modeling. In this paper, we propose LF Omnidirectional Mamba (LFOmniMamba) to address these challenges through two key components. First, the Domain-Enhanced Mamba (DEMamba) preserves and enhances local 4D consistency when processing light field subspaces via its internally integrated LF Neighbor-Guided Block. Second, the Pseudo-4D Mamba (P4DMamba) achieves efficient holistic global feature refinement through multi-scale 4D Mamba modeling. Building upon LFOmniMamba, we further propose LFOmniSR for comprehensive 4D feature extraction in LFSSR. Extensive benchmark experiments demonstrate that LFOmniSR outperforms state-of-the-art methods.