Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Deep learning to classify driver sleepiness from electrophysiological data
Linköping University, Department of Biomedical Engineering.
Linköping University, Department of Biomedical Engineering.
2019 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

Driver sleepiness is a cause for crashes and it is estimated that 3.9 to 33 % of all crashes might be related to sleepiness at the wheel. It is desirable to get an objective measurement of driver sleepiness for reduced sensitivity to subjective variations. Using deep learning for classification of driver sleepiness could be a step toward this objective. In this master thesis, deep learning was used for investigating classification of electrophysiological data, electroencephalogram (EEG) and electrooculogram (EOG), from drivers into levels of sleepiness. The EOG reflects eye position and EEG reflects brain activity. Initially, the intention was to include electrocardiogram (ECG), which reflects heart activity, in the research but this data were later excluded. Both raw time series data and data transformed into time-frequency domain representations were fed into the developed neural networks and for comparison manually extracted features were used in a shallow neural network architecture. Investigation of using EOG and EEG data separately as input was performed as well as a combination as input. The data were labeled using the Karolinska Sleepiness Scale, and the scale was divided into two labels "fatigue" and "alert" for binary classification or in five labels for comparison of classification and regression. The effect of example length was investigated using 150 seconds, 60 seconds and 30 seconds data.

Different variations of the main network architecture were used depending on the data representation and the best result was given when using a combination of a convolutional neural network (CNN) and a long short-term memory (LSTM) network with time distributed 150 seconds EOG data as input. The accuracy was in this case 80.4 % and the majority of both alert and fatigue epochs were classified correctly with 85.7 % and 66.7 % respectively. Using the optimal threshold from the created receiver operating characteristics (ROC) curve resulted in a more balanced classifier with 76.3 % correctly classified alert examples and 79.2 % correctly classified fatigue examples. The results from the EEG data, both in terms of accuracy and distribution of correctly classified examples, were shown to be less promising compared to EOG data. Combining EOG and EEG signals was shown to slightly increase the proportion of correctly classified fatigue examples. However, more promising results were obtained when balancing the classifier for solely EOG signals. The overall result from this project shows that there are patterns in the data connected to sleepiness that the neural network can find which makes further work on applying deep learning to the area of driver sleepiness interesting.

Place, publisher, year, edition, pages
2019. , p. 75
Keywords [en]
Driver Sleepiness Detection, KSS, Signal Processing, Deep Learning, Electrophysiological Signals
National Category
Medical Engineering
Identifiers
URN: urn:nbn:se:liu:diva-157498ISRN: LIU-IMT-TFK-A–19/571–SEOAI: oai:DiVA.org:liu-157498DiVA, id: diva2:1324780
External cooperation
Statens väg- och transportforskningsinstitut, VTI
Presentation
2019-06-05, IMT1, Campus US, Linköping, 13:15 (Swedish)
Supervisors
Examiners
Available from: 2019-06-14 Created: 2019-06-14 Last updated: 2019-06-14Bibliographically approved

Open Access in DiVA

fulltext(4617 kB)133 downloads
File information
File name FULLTEXT01.pdfFile size 4617 kBChecksum SHA-512
0a53ad4124dfc894d168884252763082e9ad4986ca6117ce7ebcbd2302c06135dc5b254e84876eec073a3ba0352b88e53b006666002f070117226746982a6ff0
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Johansson, IdaLindqvist, Frida
By organisation
Department of Biomedical Engineering
Medical Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 133 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 355 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf