Automatic initialization for facial analysis in interactive robotics

Authors:
Ahmad Rabie;Christian Lang;Marc Hanheide;Modesto Castrillón-Santana;Gerhard Sagerer
Affiliations:
Applied Computer Science Group, Fac. of Techn., Bielefeld University, Germany;Applied Computer Science Group, Fac. of Techn., Bielefeld University, Germany;Applied Computer Science Group, Fac. of Techn., Bielefeld University, Germany;SIANI, University of Las Palmas de Gran Canaria, Spain;Applied Computer Science Group, Fac. of Techn., Bielefeld University, Germany
Venue:
ICVS'08 Proceedings of the 6th international conference on Computer vision systems
Year:
2008

Citing 10
Cited 1

The nature of statistical learning theory

The nature of statistical learning theory
Active Appearance Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Statistical Learning of Multi-view Face Detection

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
A Mobile Robot That Recognizes People

TAI '95 Proceedings of the Seventh International Conference on Tools with Artificial Intelligence
Face recognition: A literature survey

ACM Computing Surveys (CSUR)
Robust Real-Time Face Detection

International Journal of Computer Vision
Overview of the Face Recognition Grand Challenge

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
A first evaluation study of a database of kinetic facial expressions (DaFEx)

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
A Real-life Test of Face Recognition System for Dialogue Interface Robot in Ubiquitous Environments

ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 03
ENCARA2: Real-time detection of multiple faces at different resolutions in video streams

Journal of Visual Communication and Image Representation

Regression-based Active Appearance Model initialization for facial feature tracking with missing frames

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

The human face plays an important role in communication as it allows to discern different interaction partners and provides nonverbal feedback. In this paper, we present a soft real-time vision system that enables an interactive robot to analyze faces of interaction partners not only to identify them, but also to recognize their respective facial expressions as a dialog-controlling non-verbal cue. In order to assure applicability in real world environments, a robust detection scheme is presented which detects faces and basic facial features such as the position of the mouth, nose, and eyes. Based on these detected features, facial parameters are extracted using active appearance models (AAMs) and conveyed to support vector machine (SVM) classifiers to identify both persons and facial expressions. This paper focuses on four different initialization methods for determining the initial shape for the AAM algorithm and their particular performance in two different classification tasks with respect to either the facial expression DaFEx database and to the real world data obtained from a robot's point of view.