Author:

Keywords:

Science & Technology, Technology, Engineering, Biomedical, Engineering, Sleep, Transformers, Brain modeling, Uncertainty, Databases, Task analysis, Electroencephalography, Automatic sleep staging, deep neural network, interpretability, sequence-to-sequence, transformer, uncertainty estimation, INTERRATER RELIABILITY, RESEARCH RESOURCE, NEURAL-NETWORK, Humans, Polysomnography, Sleep Stages, STADIUS-21-168, 0801 Artificial Intelligence and Image Processing, 0903 Biomedical Engineering, 0906 Electrical and Electronic Engineering, Biomedical Engineering, 4003 Biomedical engineering, 4009 Electronics, sensors and digital hardware, 4603 Computer vision and multimedia computation

Abstract:

BACKGROUND: Black-box skepticism is one of the main hindrances impeding deep-learning-based automatic sleep scoring from being used in clinical environments. METHODS: Towards interpretability, this work proposes a sequence-to-sequence sleep-staging model, namely SleepTransformer. It is based on the transformer backbone and offers interpretability of the model's decisions at both the epoch and sequence level. We further propose a simple yet efficient method to quantify uncertainty in the model's decisions. The method, which is based on entropy, can serve as a metric for deferring low-confidence epochs to a human expert for further inspection. RESULTS: Making sense of the transformer's self-attention scores for interpretability, at the epoch level, the attention scores are encoded as a heat map to highlight sleep-relevant features captured from the input EEG signal. At the sequence level, the attention scores are visualized as the influence of different neighboring epochs in an input sequence (i.e. the context) to recognition of a target epoch, mimicking the way manual scoring is done by human experts. CONCLUSION: Additionally, we demonstrate that SleepTransformer performs on par with existing methods on two databases of different sizes. SIGNIFICANCE: Equipped with interpretability and the ability of uncertainty quantification, SleepTransformer holds promise for being integrated into clinical settings.