MSleepNet: A Semi-supervision Based Multi-view Hybrid Neural Network for Simultaneous Sleep Arousal and Sleep Stage Detection

The complexity of sleep disorder diagnosis continuously increases the clinical requirement on simultaneous measurement of sleep arousal and sleep stage, which however has not received enough attention from engineering scholars. To the best of our knowledge, all previous machine learning based detection methods use the single view mechanism to identify either sleep arousal or sleep stage. In this paper, a multi-view hybrid neural network with semi-supervised learning, named as MSleepNet, is proposed for simultaneous sleep arousal and sleep stage detection. In particular, the features of single-channel electroencephalography signal from both time domain and frequency domain are extracted by the improved residual backbone network. Then an attention mechanism is introduced to enhance the feature recognition ability in the frequency domain. A multi-task classification loss function is also designed to synchronously consider the correlation between sleep arousal and sleep stage. In the classification part of the network, the supervised loss and semi-supervised loss for each task are effectively combined to alleviate the data imbalance problem and improve the classification accuracy. Overnight polysomnographic recordings from two public datasets (SHHS, n=200; Physio2018, n=100) and one dataset from local clinic (n=60) were applied to validate MSleepNet. Experimental results on Physio2018 dataset demonstrate that MSleepNet achieves overall accuracy of 0.78 and F1 score of 0.73 for sleep staging, and AUPRC of 0.39 and AUROC of 0.75 for sleep arousal detection. Therefore, MSleepNet framework based on multi-view hybrid neural network has shown its potential in intelligent sleep monitory for synchronizing sleep arousal and sleep stage measurement with only very limited labeled data.