Driver Monitoring of Automated Vehicles by Classification of Driver Drowsiness using a Deep Convolutional Neural Network Trained by Scalograms of ECG Signals

Sadegh Arefnezhad, Arno Eichberger, Matthias Frühwirth, Clemens Kaufmann, Maximilian Moser , Ioana Victoria Koglbauer

Publikation: Beitrag in einer FachzeitschriftArtikelBegutachtung

Abstract

Driver drowsiness is one of the leading causes of traffic accidents. This paper proposes a new method for classifying driver drowsiness using deep convolution neural networks trained by wavelet scalogram images of electrocardiogram (ECG) signals. Three different classes were de-fined for drowsiness based on video observation of driving tests performed in a simulator for manual and automated modes. The Bayesian optimization method is employed to optimize the hyperparameters of the designed neural networks, such as the learning rate and the number of neurons in every layer. To assess the results of the deep network method, Heart Rate Variability (HRV) data is derived from the ECG signals, some features are extracted from this data, and finally, random forest and k-nearest neighbors (KNN) classifiers are used as two traditional methods to classify the drowsiness levels. Results show that the trained deep network achieves balanced accuracies of about 77% and 79% in the manual and automated modes, respectively. However, the best obtained balanced accuracies using traditional methods are about 62% and 64%. We conclude that designed deep networks working with wavelet scalogram images of ECG signals significantly outperform KNN and random forest classifiers which are trained on HRV-based features.
Originalspracheenglisch
Seitenumfang25
FachzeitschriftEnergies
PublikationsstatusAngenommen/In Druck - Jan 2022

ASJC Scopus subject areas

  • Fahrzeugbau

Fields of Expertise

  • Mobility & Production

Treatment code (Nähere Zuordnung)

  • Application

Fingerprint

Untersuchen Sie die Forschungsthemen von „Driver Monitoring of Automated Vehicles by Classification of Driver Drowsiness using a Deep Convolutional Neural Network Trained by Scalograms of ECG Signals“. Zusammen bilden sie einen einzigartigen Fingerprint.

Dieses zitieren