MSFL-RGF: multi-stream feature learning and region-aware graph fusion for EEG-fNIRS brain decoding
摘要
Accurate decoding of neural activity is critical for brain-computer interfaces, yet unimodal electroencephalography (EEG) or functional near-infrared spectroscopy (fNIRS) suffer from limited temporal or spatial resolution. We propose a Multi-Stream Feature Learning and Region-Aware Graph Fusion (MSFL-RGF) framework that integrates EEG and fNIRS with enhanced interpretability. Six complementary feature streams are embedded into brain graphs and refined through an Adaptive Graph Connectivity Module and an Adaptive Residual Graph Convolution Block. A region-aware pooling mechanism aggregates node features into anatomically defined brain regions, followed by intra- and inter-modality probabilistic fusion. Experimental results on a Word Generation task dataset demonstrate that MSFL-RGF achieves a classification accuracy of 95.3% while improving interpretability.