Facial expression measurement for detecting driver drowsiness

  • Authors:

  • Satori Hachisuka;Kenji Ishida;Takeshi Enya;Masayoshi Kamijo

  • Affiliations:

  • DENSO CORPORATION, Research Laboratories, Nisshin-shi, Aichi-ken, Japan;DENSO CORPORATION, Research Laboratories, Nisshin-shi, Aichi-ken, Japan;DENSO CORPORATION, Research Laboratories, Nisshin-shi, Aichi-ken, Japan;Interdisciplinary Graduate School of Science and Technology, Shinshu University, Ueda-shi, Nagano-ken, Japan

  • Venue:
  • EPCE'11 Proceedings of the 9th international conference on Engineering psychology and cognitive ergonomics
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents the method of detecting driver's drowsiness level from facial expressions. Our method is executed according to the following flow: taking a driver's facial image, tracing the facial features by image processing, and classifying the driver's drowsiness level by pattern classification. We found that facial expression had the highest linear correlation with brain waves as the general index of drowsiness during monotonous driving. After analyzing the facial muscle activities, we determined 17 feature points on face for detecting driver drowsiness. A camera set on a dashboard recorded the driver's facial image. We applied Active Appearance Model (AAM) for measuring the 3-dimensional coordinates of the feature points on the facial image. In order to classify drowsiness into 6 levels, we applied k-Nearest-Neighbor method. As a result, the average Root Mean Square Errors (RMSE) among 13 participants was less than 1.0 level. Our method also detected the driver's smile.