Applying Deep Neural Networks for Multi-level Classification of Driver Drowsiness Using Vehicle-based Measures

Sadegh Arefnezhad, Sajjad Samiee, Arno Eichberger, Matthias Frühwirth, Clemens Kaufmann, Emma Klotz

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Accurate and reliable detection of drivers’ drowsiness is significantly important to prevent drowsiness-related accidents. In order to design a non-obtrusive drowsiness detection system, vehicle-based measures play a vital role. This paper, presents a novel method based on deep neural networks for drowsiness detection in drivers using vehicle-based measures. The proposed method is based on a combination of convolutional neural networks (CNN) and recurrent neural networks (RNN). Five vehicle-based measures including lateral deviation from road centerline, lateral acceleration, yaw rate, steering wheel angle and steering wheel velocity are exploited as network inputs. Long-short term memory (LSTM) and gated recurrent unit (GRU) layers are used as RNN in the structure of the designed deep network and Adam optimization method is applied to train the network. The level of drowsiness is classified in three different classes including awake, moderately drowsy and extremely drowsy. The performance of the proposed method is evaluated on experimental data that were collected from 20 driving sessions in a fixed-base driving simulator. Results show that the designed deep networks outperform the classification accuracy of classical classifiers like support vector machine and k-nearest neighbors. Combination of CNN and LSTM (CNN-LSTM) shows the highest accuracy for detection of these three classes which is equal to 96.0%.
Original languageEnglish
JournalExpert Systems with Applications
Publication statusSubmitted - 3 Aug 2019

Keywords

  • Deep learning
  • driver drowsiness detection
  • recurrent convolutional networks
  • vehicle-based data

Fields of Expertise

  • Mobility & Production

Fingerprint Dive into the research topics of 'Applying Deep Neural Networks for Multi-level Classification of Driver Drowsiness Using Vehicle-based Measures'. Together they form a unique fingerprint.

  • Cite this