CFG-NeRF: coordinate-feature-gate collaborative optimization for sparse-view ancient architecture reconstruction
摘要
Sparse-view neural radiance fields (NeRFs) employed for reconstructing large-scale ancient architecture face several challenges, including geometric misalignment, inadequate synergy between high and low frequencies, and material detail distortion. To address these limitations, we propose a coordinate feature gate-based collaborative optimization and neural radiance field (CFG-NeRF) method with three novel technical contributions: (1) a multimodal injection MLP (MI-MLP) that incorporates a coordinate-based layerwise injection mechanism integrated with gradient redistribution, which dynamically balances high- and low-frequency features and replaces the single-weighted fusion process to eliminate geometric misalignment issue; (2) a feature pyramid (FP) module that enables the implementation of dynamic feature selection, bilinear resolution alignment, and adaptive weighted summation to precisely coordinate macro- and microscale structural features; (3) a cross-modal gated attention (CGA) module that generates auxiliary samples and integrates spatial-, channel-, and pixel-level attention mechanisms to calibrate reflective material features via physical constraints. Extensive experiments conducted on the Zhantan Temple dataset demonstrate state-of-the-art performance, with CFG-NeRF achieving 22.73 dB PSNR, 0.735 SSIM, and 0.174 LPIPS–surpassing the best baseline by 16.27%, 12.21%, and 33.84%, respectively. The code is available at https://github.com/wangsaiweiwsw/CFG-NeRF.