A new dual-attention multi-node fusion network for EEG-fNIRS motor imagery classification
Author Identifier (ORCID)
Abstract
Brain-computer interface (BCI) based on motor imagery (MI) can realize the direct control of external devices by decoding different signals. The decoding of MI based on electroencephalogram (EEG) suffers from low spatial resolution and is susceptible to noise. Functional near-infrared spectroscopy (fNIRS) has attracted increasing attention as a complementary modality. There have been attempts to fuse the two types of signals, but their spatio-temporal characteristics have not been fully explored. We propose a new multimodal EEG-fNIRS fusion MI classification and recognition model based on a dual attention mechanism. The model comprises two feature extraction branches and a central fusion network. We set two fusion layers in the central fusion network to exploit the spatio-temporal features of EEG and fNIRS. To reduce redundancy and mine correlation characteristics of multiple sensors, the features are fused in the filter dimension to prevent adverse effects between signals during fusion, thereby enabling the deep network to learn cross modal correlations while reducing mutual interference. The method is evaluated on two multimodal datasets. Experiments show that DAMFNet outperforms STA-Net and M2NN by 4.49% and 2.88% on Dataset1, respectively, and shows competitive performance on Dataset2.
Keywords
attention mechanism, brain-computer interface (BCI), motor imagery (MI), multi modal fusion
Document Type
Journal Article
Date of Publication
1-1-2026
ISSN
21682194
PubMed ID
42329949
Publication Title
IEEE Journal of Biomedical and Health Informatics
Publisher
IEEE
School
School of Engineering
Copyright
subscription content
Content Type
Metadata only
Recommended Citation
Feng, L., Xu, B., Duan, L., Jia, S., Jia, Z., & Ni, W. (2026). A new dual-attention multi-node fusion network for EEG-fNIRS motor imagery classification. IEEE Journal of Biomedical and Health Informatics. Advance online publication. https://doi.org/10.1109/JBHI.2026.3706103