<p>UAV-Ground visual tracking is to achieve robust tracking by leveraging the discriminative information from both UAV and ground views. The existing approach uses a multi-view collaborative model to associate and fuse target features from different views by calculating the appearance similarity. However, it fails in challenging scenarios due to cross-view spatial misalignment caused by ignored geometric relations. To handle this problem, we propose a robust UAV-Ground tracker based on the novel Geometric Relation Prediction Transformer (GRPT), which leverages the coordinate offset of the target between two views to achieve accurate collaborative modeling. Moreover, we design a SRA strategy to adaptively correct the location of search regions for cross-view spatial alignment. We evaluate our method on public dataset UGVT, achieving 82.5% PR in UAV view, improving the baseline by 3.9%.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Geometrical Relation Prediction Transformer for UAV-Ground Visual Tracking

  • Yun Xiao,
  • Song Chen,
  • Leilei Cheng,
  • Chenglong Li,
  • Aiwu Zhou,
  • Jin Tang

摘要

UAV-Ground visual tracking is to achieve robust tracking by leveraging the discriminative information from both UAV and ground views. The existing approach uses a multi-view collaborative model to associate and fuse target features from different views by calculating the appearance similarity. However, it fails in challenging scenarios due to cross-view spatial misalignment caused by ignored geometric relations. To handle this problem, we propose a robust UAV-Ground tracker based on the novel Geometric Relation Prediction Transformer (GRPT), which leverages the coordinate offset of the target between two views to achieve accurate collaborative modeling. Moreover, we design a SRA strategy to adaptively correct the location of search regions for cross-view spatial alignment. We evaluate our method on public dataset UGVT, achieving 82.5% PR in UAV view, improving the baseline by 3.9%.