Dual-CNN based multi-modal sleep scoring with temporal correlation driven fine-tuning

•Dual-CNN copes with multi-modal neural signals without excessive a priori knowledge.•RNN based constraining strategy handles epoch-level temporal correlations.•Customized Markov chain amortizes the scoring bias caused by imbalance of brain state.•A lightweight solution to sleep scoring excels in accuracy with promotion of 2.9%.