Epipolar constraint-guided differentiable keypoint detection and description
摘要
Sparse local feature matching techniques have made significant strides in a variety of visual geometry tasks. Among them, the weakly supervised methods have drawn particular attention recently and outperform the fully supervised counterparts via decoupled describe-then-detect training. However, they often rely on policy gradients for detector training, overlooking keypoint reliability. Meanwhile, many of the sparse local feature matching methods put more emphasis on accuracy over speed, making them unfriendly for real-time applications. To address these issues, we introduce the differentiable keypoint extraction and the dispersity peak loss to generate clean score maps and enhance the reliability of the keypoints. The proposed model is trained under the weakly supervised fashion by leveraging the epipolar constraint between images. Additionally, we propose an efficient model that achieves a good balance between accuracy and speed. Experiments on various public benchmarks show our method achieving higher performance than existing ones. Code will be available at https://github.com/FYL0123/WSDK.