LS-Occ:light specific-target-focus vision-based 3D occupancy prediction with adaptive combined head
摘要
Perception is essential for autonomous driving (AD), where accurate and efficient 3D scene understanding from multi-camera inputs remains a core challenge. 3D object detection often struggles with fine-grained scene reconstruction and rare object recognition. In contrast, 3D occupancy prediction offers dense voxel-based representations for safety-critical tasks, yet most existing occupancy prediction methods rely on heavy 3D voxel-based processing, leading to significant computational overhead. Incorporating object detection tasks can provide strong spatial priors that enhance the accuracy and structural consistency of occupancy prediction. Although some recent works leverage detection tasks to aid occupancy prediction, these approaches generally involve multiple network branches or sophisticated post-processing. We propose LSOcc, a lightweight 3D occupancy prediction framework that leverages object detection as a spatial prior to enhance occupancy prediction with a pure vision modality. To enhance occupancy prediction, we introduce a Specific-target Focus Pre-training strategy that performs semantic segmentation on key detection classes within the image backbone. Furthermore, we design an Adaptive Combined Head that fuses detection-aware BEV features into the occupancy head, enhancing occupancy perception-particularly for critical object categories. Experiments on the Occ3D-nuScenes benchmark demonstrate that LSOcc achieves the highest (37.16 mIoU) occupancy performance with only a ResNet-50 backbone and a 256