Computer vision has recently made notable progress, with deep learning-based approaches demonstrating outstanding performance in visual classification tasks. Fine-grained visual classification (FGVC) still faces challenges due to high inter-class similarity and substantial intra-class differences. Vision Transformer (ViT), leveraging the self-attention mechanism, has demonstrated impressive performance in FGVC. Nevertheless, further performance enhancement necessitates refined processing of local features. To tackle this issue, this paper introduces an improved ViT-based approach. A Dynamic Local Feature Enhancement Module is introduced into the ViT backbone, which adaptively focuses on discriminative regions using deformable attention and enhances local feature representations by incorporating frequency-domain channel attention. Second, Adaptive Attention Feature Fusion Module is designed, integrating CBAM to achieve complementary learning between global and local features. Finally, ArcFace Loss is incorporated alongside conventional cross-entropy loss to optimize class boundaries.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

EFF-ViT: A Vision Transformer with Feature Enhancement and Fusion for Fine-Grained Visual Classification

  • Kaiyue Zhang,
  • Yongjiang Xue,
  • Ling Du,
  • Qingzeng Song

摘要

Computer vision has recently made notable progress, with deep learning-based approaches demonstrating outstanding performance in visual classification tasks. Fine-grained visual classification (FGVC) still faces challenges due to high inter-class similarity and substantial intra-class differences. Vision Transformer (ViT), leveraging the self-attention mechanism, has demonstrated impressive performance in FGVC. Nevertheless, further performance enhancement necessitates refined processing of local features. To tackle this issue, this paper introduces an improved ViT-based approach. A Dynamic Local Feature Enhancement Module is introduced into the ViT backbone, which adaptively focuses on discriminative regions using deformable attention and enhances local feature representations by incorporating frequency-domain channel attention. Second, Adaptive Attention Feature Fusion Module is designed, integrating CBAM to achieve complementary learning between global and local features. Finally, ArcFace Loss is incorporated alongside conventional cross-entropy loss to optimize class boundaries.