Real-time eye, gaze, and face pose tracking for monitoring driver vigilance

Authors:
Qiang Ji;Xiaojie Yang
Affiliations:
Department of Electrical, Computer, and System Engineering Rensselaer Polytechnic Institute, Troy, NY;Department of Computer Science, University of Nevada, Reno, NV
Venue:
Real-Time Imaging
Year:
2002

Citing 6
Cited 42

A framework for spatiotemporal control in the tracking of visual contours

International Journal of Computer Vision
Computing 3-D head orientation from a monocular image sequence

FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
A real-time face tracker

WACV '96 Proceedings of the 3rd IEEE Workshop on Applications of Computer Vision (WACV '96)
Non-Intrusive Gaze Tracking Using Artificial Neural Networks

Non-Intrusive Gaze Tracking Using Artificial Neural Networks
Monitoring Head/Eye Motion for Driver Alertness with One Camera

ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 4
Recognition of human head orientation based on artificial neural networks

IEEE Transactions on Neural Networks

Robust real-time eye detection and tracking under variable lighting conditions and various face orientations

Computer Vision and Image Understanding - Special issue on eye detection and tracking
A generative framework for real time object detection and classification

Computer Vision and Image Understanding - Special issue on eye detection and tracking
3D reconstruction of a human face with monocular camera based on head movement

VIP '05 Proceedings of the Pan-Sydney area workshop on Visual information processing
Combining environmental cues & head gestures to interact with wearable devices

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Eye/gaze tracking in web, image and video documents

MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Human-centered computing: a multimedia perspective

MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
A visual approach for driver inattention detection

Pattern Recognition
An improved likelihood model for eye tracking

Computer Vision and Image Understanding
Multimodal human-computer interaction: A survey

Computer Vision and Image Understanding
Automatic eye winks interpretation system for human-machine interface

Journal on Image and Video Processing
A model for ontology-based scene description for context-aware driver assistance systems

Proceedings of the 1st international conference on Ambient media and systems
Human eye sclera detection and tracking using a modified time-adaptive self-organizing map

Pattern Recognition
Efficient Measurement of the Eye Blinking by Using Decision Function for Intelligent Vehicles

ICCS '07 Proceedings of the 7th international conference on Computational Science, Part IV: ICCS 2007
Driver drowsiness detection with eyelid related parameters by Support Vector Machine

Expert Systems with Applications: An International Journal
Robust real-time eye detection and tracking under variable lighting conditions and various face orientations

Computer Vision and Image Understanding - Special issue on eye detection and tracking
A generative framework for real time object detection and classification

Computer Vision and Image Understanding - Special issue on eye detection and tracking
A noninvasive system for evaluating driver vigilance level examining both physiological and mechanical data

IEEE Transactions on Intelligent Transportation Systems
On the roles of eye gaze and head dynamics in predicting driver's intent to change lanes

IEEE Transactions on Intelligent Transportation Systems
Single image face orientation and gaze detection

Machine Vision and Applications
An eye localization, tracking and blink pattern recognition system: Algorithm and evaluation

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Robust pupil detection by image difference with positional compensation

VECIMS'09 Proceedings of the 2009 IEEE international conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems
A virtual prototyping system for vehicle visibility valuation

VECIMS'09 Proceedings of the 2009 IEEE international conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems
Multimodal interfaces: Challenges and perspectives

Journal of Ambient Intelligence and Smart Environments
A wavelet subspace method for real-time face tracking

Real-Time Imaging
Horizontal human face pose determination using pupils and skin region positions

PSIVT'07 Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology
Real-time driving danger-level prediction

Engineering Applications of Artificial Intelligence
Virtual driving and eco-simulation: VR city modeling, drive simulation, and ecological habits

SpringSim '10 Proceedings of the 2010 Spring Simulation Multiconference
Driver drowsiness warning system using visual information for both diurnal and nocturnal illumination conditions

EURASIP Journal on Advances in Signal Processing - Special title on vehicular ad hoc networks
Driving fatigue detection using active shape models

ISVC'10 Proceedings of the 6th international conference on Advances in visual computing - Volume Part III
A graphical model based solution to the facial feature point tracking problem

Image and Vision Computing
Robust real-time multi-user pupil detection and tracking under various illumination and large-scale head motion

Computer Vision and Image Understanding
Gaze direction determination of opponents and teammates in robot soccer

RoboCup 2005
Multimodal recognition of reading activity in transit using body-worn sensors

ACM Transactions on Applied Perception (TAP)
An eye detection system based on neural autoassociators

ANNPR'06 Proceedings of the Second international conference on Artificial Neural Networks in Pattern Recognition
A real-time driver visual attention monitoring system

IbPRIA'05 Proceedings of the Second Iberian conference on Pattern Recognition and Image Analysis - Volume Part I
Multimodal interfaces: Challenges and perspectives

Journal of Ambient Intelligence and Smart Environments
Kernelized Fuzzy Rough Sets Based Yawn Detection for Driver Fatigue Monitoring

Fundamenta Informaticae - Knowledge Technology
A miniature head-mounted camera for measuring eye closure

Proceedings of the 27th Conference on Image and Vision Computing New Zealand
Online vigilance analysis combining video and electrooculography features

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part V
Driver drowsiness monitoring application with graphical user interface

UCAmI'12 Proceedings of the 6th international conference on Ubiquitous Computing and Ambient Intelligence
Alcohol consumption detection through behavioural analysis using intelligent systems

Expert Systems with Applications: An International Journal
Visual Focus of Attention in Non-calibrated Environments using Gaze Estimation

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes a real-time prototype computer vision system for monitoring driver vigilance. The main components of the system consists of a remotely located video CCD camera, a specially designed hardware system for real-time image acquisition and for controlling the illuminator and the alarm system, and various computer vision algorithms for simultaneously, real-time and non-intrusively monitoring various visual bio-behaviors that typically characterize a driver's level of vigilance. The visual behaviors include eyelid movement, face orientation, and gaze movement (pupil movement). The system was tested in a simulating environment with subjects of different ethnic backgrounds, different genders, ages, with/without glasses, and under different illumination conditions, and it was found very robust, reliable and accurate.