Electroencephalogram (EEG) based seizure prediction plays an important role in the closed-loop neuromodulation system. However, most existing seizure prediction methods based on graph convolution network only focused on constructing the static graph, ignoring multi-domain dynamic changes in deep graph structure. Moreover, the existing feature fusion strategies generally concatenated coarse-grained epileptic EEG features directly, leading to the suboptimal seizure prediction performance. To address these issues, we propose a novel multi-branch dynamic multi-graph convolution based channel-weighted transformer feature fusion network (MB-dMGC-CWTFFNet) for the patient-specific seizure prediction with the superior performance. Specifically, a multi-branch (MB) feature extractor is first applied to capture the temporal, spatial and spectral representations fromthe epileptic EEG jointly. Then, we design a point-wise dynamic multi-graph convolution network (dMGCN) to dynamically learn deep graph structures, which can effectively extract high-level features from the multi-domain graph. Finally, by integrating the local and global channel-weighted strategies with the multi-head self-attention mechanism, a channel-weighted transformer feature fusion network (CWTFFNet) is adopted to efficiently fuse the multi-domain graph features. The proposed MB-dMGC-CWTFFNet is evaluated on the public CHB-MIT EEG and a private intracranial sEEG datasets, and the experimental results demonstrate that our proposed method achieves outstanding prediction performance compared with the state-of-the-art methods, indicating an effective tool for patient-specific seizure warning. Our code will be available at: https://github.com/Rockingsnow/MB-dMGC-CWTFFNet.
基金:
Beijing Natural Science Foundation [Z220017]; National Natural Science Foundation of China [62325301, 62201023]; China Postdoctoral Science Foundation [2023M730175]; Beijing Municipal Education Commission-Natural Science Foundation [KZ202110025036]; Beijing United Imaging Research Institute of Intelligent Imaging Foundation [CRIB-JQY202103]
第一作者机构:[1]Beihang Univ, Dept Automat Sci & Elect Engn, Beijing 100191, Peoples R China
通讯作者:
推荐引用方式(GB/T 7714):
Wang Yifan,Cui Weigang,Yu Tao,et al.Dynamic Multi-Graph Convolution-Based Channel-Weighted Transformer Feature Fusion Network for Epileptic Seizure Prediction[J].IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING.2023,31:4266-4277.doi:10.1109/TNSRE.2023.3321414.
APA:
Wang, Yifan,Cui, Weigang,Yu, Tao,Li, Xiaoli,Liao, Xiaofeng&Li, Yang.(2023).Dynamic Multi-Graph Convolution-Based Channel-Weighted Transformer Feature Fusion Network for Epileptic Seizure Prediction.IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING,31,
MLA:
Wang, Yifan,et al."Dynamic Multi-Graph Convolution-Based Channel-Weighted Transformer Feature Fusion Network for Epileptic Seizure Prediction".IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING 31.(2023):4266-4277