<p>Detecting human emotions from brain signals is fundamental for building intuitive and adaptive human–computer interfaces (HCI); However, Electroencephalography (EEG) remains challenging to interpret because the signals are non-stationary, high-dimensional, and noisy. This study evaluated whether an attention-guided hybrid deep-learning architecture can deliver reliable, subject-independent emotion recognition from EEG. To answer this, a lightweight CNN–LSTM–CBAM network model is proposed that (i) extracts spatial–frequency features from time–frequency spectrograms with a convolutional neural network (CNN), (ii) captures temporal dynamics in principal-component EEG time-series with a long short-term memory (LSTM) layer, and (iii) refines both via a convolutional block attention module (CBAM) that applies channel- and spatial-wise attention. The model has been evaluated on the four-class SEED-IV dataset (happy, sad, fear, neutral) using a rigorous leave-one-subject-out (LOSO) protocol across 15 participants. Compared with a spectrogram-only CNN (64.21% accuracy) and a CNN–LSTM ensemble lacking attention (64.63%), the proposed network achieves 68.67% cross-subject accuracy and a 68.22% macro-F1 score, while substantially reducing class imbalance and raising the accuracy of the most challenging class, ‘happy’, by 5.4% points. A Wilcoxon signed-rank test on per-subject accuracies confirmed that the 4.0%-point improvement over the baseline, CNN–LSTM ensemble model without attention, has been statistically significant (<InlineEquation ID="IEq1"> <EquationSource Format="TEX">\(p&lt;0.01\)</EquationSource> </InlineEquation>). In contrast to recent literature (2020–present), including recent online-first publications, this method offers competitive performance with significantly fewer parameters and consistent subject-to-subject results. These findings demonstrate that channel-and spatial attention embedded in a hybrid CNN–LSTM pipeline can mitigate EEG noise, balance class performance, and advance practical, real-time affective brain–computer interfaces.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Hybrid CNN–LSTM network for cross-subject EEG emotion recognition

  • Hashim Ali,
  • Zangar Ermaganbet,
  • Muhammad Tahir Akhtar

摘要

Detecting human emotions from brain signals is fundamental for building intuitive and adaptive human–computer interfaces (HCI); However, Electroencephalography (EEG) remains challenging to interpret because the signals are non-stationary, high-dimensional, and noisy. This study evaluated whether an attention-guided hybrid deep-learning architecture can deliver reliable, subject-independent emotion recognition from EEG. To answer this, a lightweight CNN–LSTM–CBAM network model is proposed that (i) extracts spatial–frequency features from time–frequency spectrograms with a convolutional neural network (CNN), (ii) captures temporal dynamics in principal-component EEG time-series with a long short-term memory (LSTM) layer, and (iii) refines both via a convolutional block attention module (CBAM) that applies channel- and spatial-wise attention. The model has been evaluated on the four-class SEED-IV dataset (happy, sad, fear, neutral) using a rigorous leave-one-subject-out (LOSO) protocol across 15 participants. Compared with a spectrogram-only CNN (64.21% accuracy) and a CNN–LSTM ensemble lacking attention (64.63%), the proposed network achieves 68.67% cross-subject accuracy and a 68.22% macro-F1 score, while substantially reducing class imbalance and raising the accuracy of the most challenging class, ‘happy’, by 5.4% points. A Wilcoxon signed-rank test on per-subject accuracies confirmed that the 4.0%-point improvement over the baseline, CNN–LSTM ensemble model without attention, has been statistically significant ( \(p<0.01\) ). In contrast to recent literature (2020–present), including recent online-first publications, this method offers competitive performance with significantly fewer parameters and consistent subject-to-subject results. These findings demonstrate that channel-and spatial attention embedded in a hybrid CNN–LSTM pipeline can mitigate EEG noise, balance class performance, and advance practical, real-time affective brain–computer interfaces.