Applying Deep Neural Networks for Multi-level Classification of Driver Drowsiness Using Vehicle-based Measures

Sadegh Arefnezhad*, Sajjad Samiee, Arno Eichberger, Matthias Frühwirth, Clemens Kaufmann, Emma Klotz

*Corresponding author for this work

Research output: Contribution to journalArticle

Abstract

Drowsy driving is one of the main causes of road accidents. Accurate and reliable detection of drivers' drowsiness is significantly important to prevent drowsiness-related accidents. In the context of automated vehicle driving, it is important for intelligent systems to know the current state of the driver to prepare handover maneuvers. Previous studies are mostly based on manually extracted features from either driving performance or driver physiological data. This methodology of a priori defined features can lead to losing valuable information of input signals that are significant to classify drowsiness levels in individual drivers because generally, it is not known which features are suitable for drowsiness prediction before classification. By using deep neural networks, features can be extracted automatically from preprocessed data. This paper presents a new non-obtrusive drowsiness detection system based on deep neural networks using vehicle-based measures. The proposed method is based on a combination of convolutional neural networks (CNN) and recurrent neural networks (RNN). Five vehicle-based measures, including lateral deviation from road centerline, lateral acceleration, yaw rate, steering wheel angle, and steering wheel velocity, are exploited as network inputs. The level of drowsiness is classified into three different classes. Long-short term memory (LSTM) and gated recurrent unit (GRU) layers are used as RNN in the structure of the designed deep network. The performance of the proposed method is evaluated on experimental data that were collected from 44 sessions in a fixed-base driving simulator simulating monotonous night-time highway drives. Results show that the classification accuracy of the designed deep networks outperforms traditional classifiers like support vector machine and k-nearest neighbors. The highest accuracy of 96.0% has been achieved with a combination of CNN and LSTM (CNN-LSTM). Further research should include more signal sources, including unobtrusively taken physiological signals, and test the system in real-world conditions.

Original languageEnglish
Article number113778
Number of pages12
JournalExpert Systems with Applications
Volume162
DOIs
Publication statusPublished - 30 Dec 2020

Keywords

  • Deep learning
  • driver drowsiness detection
  • recurrent convolutional networks
  • vehicle-based data
  • Vehicle-based data
  • Driver drowsiness detection
  • Recurrent convolutional networks

ASJC Scopus subject areas

  • Automotive Engineering
  • Engineering(all)
  • Artificial Intelligence
  • Computer Science Applications

Fields of Expertise

  • Mobility & Production

Treatment code (Nähere Zuordnung)

  • Basic - Fundamental (Grundlagenforschung)
  • Experimental

Fingerprint Dive into the research topics of 'Applying Deep Neural Networks for Multi-level Classification of Driver Drowsiness Using Vehicle-based Measures'. Together they form a unique fingerprint.

Cite this