Dense connection structures have garnered considerable interest in the deep learning domain due to their efficient feature reuse capabilities. However, their potential within Transformer architectures remains underexplored. To address the issues of feature collapse and inadequate multi-scale learning capabilities in classical Vision Transformers (ViT), we propose a feature learning method integrating dense connections, learnable weight matrices, and pyramid convolutions. The approach achieves efficient multi-layer feature reuse through dense connection structures while employing weight matrices to regulate the influence of different layers on final attention scores. We conducted experiments on four benchmark datasets: CIFAR-10, CIFAR-100, Oxford-Flowers-102, and Oxford-IIIT Pet. The consequences exhibit that the densely connected ViT exhibits superior performance in classification tasks and significantly improved multi-scale learning capabilities compared to baseline models.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

DenseViT: Densely Connected Vision Transformers for Visual Recognition

  • Yurui Tian,
  • Mingqing Yuan,
  • Chunping Liu

摘要

Dense connection structures have garnered considerable interest in the deep learning domain due to their efficient feature reuse capabilities. However, their potential within Transformer architectures remains underexplored. To address the issues of feature collapse and inadequate multi-scale learning capabilities in classical Vision Transformers (ViT), we propose a feature learning method integrating dense connections, learnable weight matrices, and pyramid convolutions. The approach achieves efficient multi-layer feature reuse through dense connection structures while employing weight matrices to regulate the influence of different layers on final attention scores. We conducted experiments on four benchmark datasets: CIFAR-10, CIFAR-100, Oxford-Flowers-102, and Oxford-IIIT Pet. The consequences exhibit that the densely connected ViT exhibits superior performance in classification tasks and significantly improved multi-scale learning capabilities compared to baseline models.