LATrack: enhancing transformer visual tracking via locality-aware attention
摘要
Transformer-based trackers achieve strong performance in visual object tracking by modeling long-range dependencies via multi-head attention (MHA). However, the global scope of MHA often blurs boundaries and introduces false associations with background regions. To overcome this, we propose LATrack—a locality-enhanced Transformer framework that structurally integrates two novel modules: Criss-Cross Attention (CCA) and Correlative Masked Attention (CMA). CCA aggregates horizontal and vertical features to sharpen spatial edges, while CMA enforces continuity constraints to suppress mismatches. Unlike prior works that independently apply attention variants, LATrack unifies both modules within a Siamese architecture, enabling coordinated local–global representation learning. Extensive experiments on nine benchmarks demonstrate that LATrack achieves state-of-the-art accuracy and real-time speed, especially under occlusion, deformation, and fast motion.