Manifold estimation in view-based feature space for face synthesis across poses

Authors:
Xinyu Huang;Jizhou Gao;Sen-ching S. Cheung;Ruigang Yang
Affiliations:
Center for Visualization and Virtual Environments, University of Kentucky;Center for Visualization and Virtual Environments, University of Kentucky;Center for Visualization and Virtual Environments, University of Kentucky;Center for Visualization and Virtual Environments, University of Kentucky
Venue:
ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part I
Year:
2009

Citing 17
Cited 1

Visual learning and recognition of 3-D objects from appearance

International Journal of Computer Vision
Linear Object Classes and Image Synthesis From a Single Example Image

IEEE Transactions on Pattern Analysis and Machine Intelligence
A morphable model for the synthesis of 3D faces

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Active Appearance Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multilinear Analysis of Image Ensembles: TensorFaces

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part I
Recovery of Reflectances and Varying Illuminants from Multiple Views

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
On Utilising Template and Feature-Based Correspondence in Multi-view Appearance Models

ECCV '00 Proceedings of the 6th European Conference on Computer Vision-Part I
Face Recognition from Unfamiliar Views: Subspace Methods and Pose Dependency

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
View-Based Active Appearance Models

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Face Recognition Based on Fitting a 3D Morphable Model

IEEE Transactions on Pattern Analysis and Machine Intelligence
On Modelling Nonlinear Shape-and-Texture Appearance Manifolds

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Kernel-Based Multifactor Analysis for Image Synthesis and Recognition

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Separating Style and Content with Bilinear Models

Neural Computation
Graph Embedded Analysis for Head Pose Estimation

FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
3D Alignment of Face in a Single Image

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Real-time combined 2D+3D active appearance models

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Video-based face recognition using probabilistic appearance manifolds

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition

Sparse frontal face image synthesis from an arbitrary profile image

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a new approach to synthesize face images under different pose changes given a single input image. The approach is based on two observations: 1. a series of face images of a single person under different poses could be mapped to a smooth manifold in the unified feature space. 2. the manifolds from different faces are separated from each other by their dissimilarities. The new manifold estimation is formulated as an energy minimization problem with smoothness constraints. The experiments show that face images under different poses can be robustly synthesized from one input image, even with large pose variations.