Toward robust face analysis method of non-cooperative persons in stereo color image sequences

  • Authors:
  • Ayoub K. Al-Hamadi;Robert Niese;Axel Panning;Bernd Michaelis

  • Affiliations:
  • Institute for Electronics, Signal Processing and Communications, Otto von Guericke University Magdeburg;Institute for Electronics, Signal Processing and Communications, Otto von Guericke University Magdeburg;Institute for Electronics, Signal Processing and Communications, Otto von Guericke University Magdeburg;Institute for Electronics, Signal Processing and Communications, Otto von Guericke University Magdeburg

  • Venue:
  • Machine Graphics & Vision International Journal
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes a novel method for analyzing single faces of non-cooperative persons on the basis of stereoscopic color images. The challenges arise from the fact that the persons observed are non-cooperative, which in turn complicates further processing as facial feature extraction and tracking in image sequence. In our method, face detection is based on color-driven clustering of 3D points derived from stereo. A mesh model is registered with a post-processed face cluster, using a variant of the Iterative Closest Point algorithm (ICP). The pose is derived from correspondence. Then, the pose and model information are used for face normalization and facial feature localization. Automatic extraction of facial features is carried out using modified Active Shape Models (ASM). In contrast to the simple ASM, another approach is pursued in this work. It involves two modifications to the ASM, which lead to greater stability and robustness. The results show that stereo and color are powerful cues for finding the face and its pose, and for facial feature extraction under a wide range of poses, illumination types and expressions (PIE).