Hierarchical Adaptive Position Encoding-Based Transformer for Point Cloud Analysis
摘要
In recent years, transformers have significantly advanced 3D point cloud analysis by capturing long-range dependencies. Current methods focus on complex local feature processing, leading to substantial neighbor preparation and position embedding overhead, and fail to model remote context dependencies directly. Additionally, learned position embeddings struggle to integrate point cloud spatial information with deep features, impairing effective feature learning and target perception. We propose HAPE-Net, which excels in capturing remote context and demonstrates strong generalization and performance. Our method utilizes a Global Position Attention (GPA) module with Hierarchical Adaptive Position Encoding (HAPE), combined with an efficient Local Squeeze Aggregation (LSA) operator for local feature extraction, capturing shape context within and between point sets. HAPE adapts to network depth, promoting spatial and semantic information fusion. LSA and GPA effectively model short-range and long-range spaces, respectively. Our approach requires no additional operations like local position embedding or neighbor preparation. Experiments on ScanObjectNN, ShapeNetPart, and S3DIS demonstrate HAPE-Net’s effectiveness in point cloud classification and segmentation, surpassing previous methods.