Real-time eye blink detection with GPU-based SIFT tracking

Authors:
Marc Lalonde;David Byrns;Langis Gagnon;Normand Teasdale;Denis Laurendeau
Affiliations:
CRIM, 550 Sherbrooke West, Suite 100, Montreal, QC, Canada;CRIM, 550 Sherbrooke West, Suite 100, Montreal, QC, Canada;CRIM, 550 Sherbrooke West, Suite 100, Montreal, QC, Canada;Laval University;Laval University
Venue:
CRV '07 Proceedings of the Fourth Canadian Conference on Computer and Robot Vision
Year:
2007

Citing 0
Cited 4

A 3-dimensional sift descriptor and its application to action recognition

Proceedings of the 15th international conference on Multimedia
COBVIS-D: A Computer Vision System for Describing the Cephalo-Ocular Behavior of Drivers in a Driving Simulator

ICIAR '09 Proceedings of the 6th International Conference on Image Analysis and Recognition
Adding facial actions into 3D model search to analyse behaviour in an unconstrained environment

ISVC'10 Proceedings of the 6th international conference on Advances in visual computing - Volume Part I
A Survey of Optical Flow Techniques for Robotics Navigation Applications

Journal of Intelligent and Robotic Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper reports on the implementation of a GPUbased, real-time eye blink detector on very low contrast images acquired under near-infrared illumination. This detector is part of a multi-sensor data acquisition and analysis system for driver performance assessment and training. Eye blinks are detected inside regions of interest that are aligned with the subject's eyes at initialization. Alignment is maintained through time by tracking SIFT feature points that are used to estimate the affine transformation between the initial face pose and the pose in subsequent frames. The GPU implementation of the SIFT feature point extraction algorithm ensures real-time processing. An eye blink detection rate of 97% is obtained on a video dataset of 33,000 frames showing 237 blinks from 22 subjects.