In industrial-grade applications, the efficiency of algorithms and models takes precedence, ensuring a certain level of performance while aligning with the specific requirements of the application and the capabilities of the underlying equipment. In recent years, the Vision Transformer has been introduced as a powerful approach to significantly improve recognition accuracy in various tasks. However, it faces challenges concerning portability, as well as high computational and input requirements. To tackle these issues, a dynamic adaptive transformer (DAT) has been proposed. This innovative method involves dynamic parameter pruning, enabling the trained Vision Transformer to adapt effectively to different tasks. Experimental results demonstrate that the dynamic adaptive transformer (DAT) is capable of reducing the model’s parameters and Gmac with minimal accuracy loss.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Driver Action Recognition Based on Dynamic Adaptive Transformer

  • Wei Xu,
  • Yu Mao,
  • Junqi Li,
  • Tao Peng,
  • Cuilan Li,
  • Yalan Fang

摘要

In industrial-grade applications, the efficiency of algorithms and models takes precedence, ensuring a certain level of performance while aligning with the specific requirements of the application and the capabilities of the underlying equipment. In recent years, the Vision Transformer has been introduced as a powerful approach to significantly improve recognition accuracy in various tasks. However, it faces challenges concerning portability, as well as high computational and input requirements. To tackle these issues, a dynamic adaptive transformer (DAT) has been proposed. This innovative method involves dynamic parameter pruning, enabling the trained Vision Transformer to adapt effectively to different tasks. Experimental results demonstrate that the dynamic adaptive transformer (DAT) is capable of reducing the model’s parameters and Gmac with minimal accuracy loss.