<p>Motor imagery (MI) is widely used in brain–computer interfaces (BCIs) due to its simplicity and reproducibility, enabling individuals with motor impairments to perform non-muscular limb training for the rehabilitation of motor-related neurons. While MI-based BCIs have shown promise for neurorehabilitation, current 2D paradigms fail to engage critical sensorimotor networks. To address this limitation, we designed an immersive MI paradigm in a virtual reality (VR) environment, where participants imagined limb movements in response to continuous three-dimensional (3D) palm motion stimuli. Furthermore, we proposed a novel decoding algorithm that integrates depthwise separable convolution with multi-head self-attention mechanisms. The proposed method was evaluated against existing approaches, demonstrating superior classification accuracy while reducing the temporal and spatial complexity associated with attention mechanisms. To assess the generalizability and robustness of the algorithm across different scenarios, we conducted experiments on two publicly available datasets: BCI Competition IV-2a and the PhysioNet MI dataset. Results showed that our method achieved an average increase of nearly 8% in kappa score over EEGNet in decoding four-class MI tasks in 2D paradigms. Consistent performance across both VR and 2D paradigms confirmed the algorithm’s effectiveness and applicability in multi-scenario MI decoding. This study introduces a novel immersive MI paradigm and decoding framework, offering a promising approach for enhancing user engagement in neurorehabilitation and advancing EEG-based intention recognition in VR environments.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Virtual Reality (VR) Paradigm-Agnostic Motor Imagery Decoding Using Lightweight Network With Adaptive Attention Mechanism

  • Rongrong Fu,
  • Yang Liu,
  • Zeyi Wang,
  • Zhenhu Liang

摘要

Motor imagery (MI) is widely used in brain–computer interfaces (BCIs) due to its simplicity and reproducibility, enabling individuals with motor impairments to perform non-muscular limb training for the rehabilitation of motor-related neurons. While MI-based BCIs have shown promise for neurorehabilitation, current 2D paradigms fail to engage critical sensorimotor networks. To address this limitation, we designed an immersive MI paradigm in a virtual reality (VR) environment, where participants imagined limb movements in response to continuous three-dimensional (3D) palm motion stimuli. Furthermore, we proposed a novel decoding algorithm that integrates depthwise separable convolution with multi-head self-attention mechanisms. The proposed method was evaluated against existing approaches, demonstrating superior classification accuracy while reducing the temporal and spatial complexity associated with attention mechanisms. To assess the generalizability and robustness of the algorithm across different scenarios, we conducted experiments on two publicly available datasets: BCI Competition IV-2a and the PhysioNet MI dataset. Results showed that our method achieved an average increase of nearly 8% in kappa score over EEGNet in decoding four-class MI tasks in 2D paradigms. Consistent performance across both VR and 2D paradigms confirmed the algorithm’s effectiveness and applicability in multi-scenario MI decoding. This study introduces a novel immersive MI paradigm and decoding framework, offering a promising approach for enhancing user engagement in neurorehabilitation and advancing EEG-based intention recognition in VR environments.