Electroencephalography (EEG) is a non-invasive and cost-effective tool for capturing brain signals. However, existing approaches based on deep learning models for classifying EEG signals are primarily trained on large EEG datasets and require extensive computational resources. This poses significant challenges for real-time processing, particularly in resource-constrained environments such as wearable devices and edge computing. Our work addresses these challenges by exploring quantization techniques to optimize a vision transformer model for real-time EEG classification. We apply post-training quantization to the proposed Vision Transformer (ViT) model, termed the Brain Signal Vision Transformer (BSVT), to reduce computational overhead while maintaining high performance. The BSVT model, trained on the ex3 HPC system, efficiently handles large datasets. We comprehensively analyze the trade-offs between model accuracy and computational efficiency. Specifically, we demonstrate the use of dynamic quantization on a ViT-based model for EEG classification, achieving a 2.49x reduction in model size and a 1.46x improvement in inference speed. These findings underscore the potential of quantization techniques and distributed computing to revolutionize the adoption of AI in healthcare.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Quantization of Vision Transformer-Based Model for Real-Time EEG Classification

  • Rabindra Khadka,
  • Poushali Sengupta,
  • Pedro G. Lind,
  • Anis Yazidi

摘要

Electroencephalography (EEG) is a non-invasive and cost-effective tool for capturing brain signals. However, existing approaches based on deep learning models for classifying EEG signals are primarily trained on large EEG datasets and require extensive computational resources. This poses significant challenges for real-time processing, particularly in resource-constrained environments such as wearable devices and edge computing. Our work addresses these challenges by exploring quantization techniques to optimize a vision transformer model for real-time EEG classification. We apply post-training quantization to the proposed Vision Transformer (ViT) model, termed the Brain Signal Vision Transformer (BSVT), to reduce computational overhead while maintaining high performance. The BSVT model, trained on the ex3 HPC system, efficiently handles large datasets. We comprehensively analyze the trade-offs between model accuracy and computational efficiency. Specifically, we demonstrate the use of dynamic quantization on a ViT-based model for EEG classification, achieving a 2.49x reduction in model size and a 1.46x improvement in inference speed. These findings underscore the potential of quantization techniques and distributed computing to revolutionize the adoption of AI in healthcare.