Looking at People: Sensing for Ubiquitous and Wearable Computing
IEEE Transactions on Pattern Analysis and Machine Intelligence
Detecting Faces in Images: A Survey
IEEE Transactions on Pattern Analysis and Machine Intelligence
On the Sequential Accumulation of Evidence
International Journal of Computer Vision - Special issue: Research at McGill University
Appearance-Based Structure from Motion Using Linear Classes of 3-D Models
International Journal of Computer Vision
Robust Parameterized Component Analysis
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Action Reaction Learning: Automatic Visual Analysis and Synthesis of Interactive Behaviour
ICVS '99 Proceedings of the First International Conference on Computer Vision Systems
HUC '99 Proceedings of the 1st international symposium on Handheld and Ubiquitous Computing
Robust parameterized component analysis: theory and applications to 2D facial appearance models
Computer Vision and Image Understanding - Special issue on Face recognition
Sensing and mapping for interactive performance
Organised Sound
ICPR '98 Proceedings of the 14th International Conference on Pattern Recognition-Volume 2 - Volume 2
Clustered Blockwise PCA for Representing Visual Data
IEEE Transactions on Pattern Analysis and Machine Intelligence
Visual tracking and recognition using probabilistic appearance manifolds
Computer Vision and Image Understanding
Face detection and tracking using a Boosted Adaptive Particle Filter
Journal of Visual Communication and Image Representation
Visual tracking and recognition using probabilistic appearance manifolds
Computer Vision and Image Understanding
Emphatic visual speech synthesis
IEEE Transactions on Audio, Speech, and Language Processing - Special issue on multimodal processing in speech-based interactions
Detecting skin in face recognition systems: A colour spaces study
Digital Signal Processing
Video-based face recognition using probabilistic appearance manifolds
CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
| Hi-index | 0.00 |
We describe a face modeling system which estimates complete facial structure and texture from a real-time video stream. The system begins with a face tracking algorithm which detects and stabilizes live facial images into a canonical 3D pose. The resulting canonical texture is then processed by a statistical model to filter imperfections and estimate unknown components such as missing pixels and underlying 3D structure. This statistical model is a soft mixture of eigenfeatures to maximize their generalization capability over a cross-validation set of data. The model's abilities to filter and estimate absent facial components are then demonstrated over incomplete 3D data. This ultimately allows the model to span known and regress unknown facial information from stabilized natural video sequences generated by a face tracking algorithm. The resulting continuous and dynamic estimation of the model's parameters over a video sequence generates a compact temporal description of the 3D deformations and texture changes of the face.