Insomnia is the most common sleep disorder linked with adverse long-term medical and psychiatric outcomes. Automatic sleep staging plays a crucial role in aiding doctors to diagnose insomnia disorder. Only a few studies have been conducted to develop automatic sleep staging methods for insomniacs, and most of them have utilized transfer learning methods, which involve pre-training models on healthy individuals and then fine-tuning them on insomniacs. Unfortunately, significant differences in feature distribution between the two subject groups impede the transfer performance, highlighting the need to effectively integrate the features of healthy subjects and insomniacs. In this paper, we propose a dual-teacher cross-domain knowledge transfer method based on the feature-based knowledge distillation to improve the performance of sleep staging for insomniacs. Specifically, the insomnia teacher directly learns from insomniacs and feeds the corresponding domain-specific features into the student network, while the health domain teacher guide the student network to learn domain-generic features. During the training process, we adopt the OFD (Overhaul of Feature Distillation) method to build the health domain teacher. We conducted the experiments to validate the proposed method, using the Sleep-EDF database as the source domain and the CAP-Database as the target domain. The results demonstrate that our method surpasses advanced techniques, achieving an average sleep staging accuracy of 80.56% on the CAP-Database. Furthermore, our method exhibits promising performance on the private dataset.
基金:
This work
was supported in part by the STI2030-Major Projects under Grant
2021ZD0204300, in part by the National Natural Science Foundation of
China under Grant 62176009, and in part by the Beijing Municipal Education
Commission and Municipal Natural Science Foundation of China
under Grant 23JA002.
第一作者机构:[1]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China[2]Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China[3]China Natl Engn Lab Crit Technol Informat Secur Cl, Beijing 100124, Peoples R China
通讯作者:
通讯机构:[1]Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China[2]Beijing Key Lab Trusted Comp, Beijing 100124, Peoples R China[3]China Natl Engn Lab Crit Technol Informat Secur Cl, Beijing 100124, Peoples R China[4]Capital Med Univ, Xuanwu Hosp, Dept Neurol, Beijing 100029, Peoples R China[5]Beijing Key Lab Neuromodulat, Beijing 100053, Peoples R China
推荐引用方式(GB/T 7714):
Duan Lijuan,Zhang Yan,Huang Zhaoyang,et al.Dual-Teacher Feature Distillation: A Transfer Learning Method for Insomniac PSG Staging[J].IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS.2024,28(3):1730-1741.doi:10.1109/JBHI.2023.3337261.
APA:
Duan, Lijuan,Zhang, Yan,Huang, Zhaoyang,Ma, Bian,Wang, Wenjian&Qiao, Yuanhua.(2024).Dual-Teacher Feature Distillation: A Transfer Learning Method for Insomniac PSG Staging.IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS,28,(3)
MLA:
Duan, Lijuan,et al."Dual-Teacher Feature Distillation: A Transfer Learning Method for Insomniac PSG Staging".IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS 28..3(2024):1730-1741