Real-Time, Fully Automatic Upper Facial Feature Tracking

Authors:
Ashish Kapoor;Rosalind W. Picard
Affiliations:
-;-
Venue:
FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Year:
2002

Citing 0
Cited 19

Fully Automatic Upper Facial Action Recognition

AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
Affective Learning — A Manifesto

BT Technology Journal
An embedded system for an eye-detection sensor

Computer Vision and Image Understanding - Special issue on eye detection and tracking
Face and body gesture recognition for a vision-based multimodal analyzer

VIP '05 Proceedings of the Pan-Sydney area workshop on Visual information processing
Head-tracking for gestural and continuous control of parameterized audio effects

NIME '03 Proceedings of the 2003 conference on New interfaces for musical expression
Multimodal affect recognition in learning environments

Proceedings of the 13th annual ACM international conference on Multimedia
Extracting eyebrow contour and chin contour for face recognition

Pattern Recognition
Automatic prediction of frustration

International Journal of Human-Computer Studies
Spatio-temporal graphical-model-based multiple facial feature tracking

EURASIP Journal on Applied Signal Processing
An automated feature-localisation algorithm for a feature-specific modular approach for face recognition

International Journal of Intelligent Systems Technologies and Applications
Human eye sclera detection and tracking using a modified time-adaptive self-organizing map

Pattern Recognition
Multi-cue Facial Feature Detection and Tracking

ICISP '08 Proceedings of the 3rd international conference on Image and Signal Processing
Affect-aware tutors: recognising and responding to student affect

International Journal of Learning Technology
An embedded system for an eye-detection sensor

Computer Vision and Image Understanding - Special issue on eye detection and tracking
Facial Expression Invariants for Estimating Mental States of Person

Proceedings of the 2009 conference on New Trends in Software Methodologies, Tools and Techniques: Proceedings of the Eighth SoMeT_09
Robust Facial Feature Detection and Tracking for Head Pose Estimation in a Novel Multimodal Interface for Social Skills Learning

ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part II
Facial feature detection under various illuminations

ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part I
Eyes location using a neural network

ISNN'06 Proceedings of the Third international conference on Advnaces in Neural Networks - Volume Part II
Building Intelligent Interactive Tutors: Student-centered strategies for revolutionizing e-learning

Building Intelligent Interactive Tutors: Student-centered strategies for revolutionizing e-learning

Quantified Score

Hi-index	0.00

Visualization

Abstract

Robust, real-time, fully automatic tracking of facial features is required for many computer vision and graphics applications. In this paper, we describe a fully automatic system that tracks eyes and eyebrows in real time. The pupils are tracked using the red eye effect by an infrared sensitive camera equipped with infrared LEDs. Templates are used to parameterize the facial features. For each new frame, the pupil coordinates are used to extract cropped images of eyes and eyebrows. The template parameters are recovered by PCA analysis on these extracted images using a PCA basis, which was constructed during the training phase with some example images. The system runs at 30 fps and requires no manual initialization or calibration. The system is shown to work well on sequences with considerable head motions and occlusions.