Shape and motion from image streams under orthography: a factorization method
International Journal of Computer Vision
Computer facial animation
Synthesizing realistic facial expressions from photographs
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
A morphable model for the synthesis of 3D faces
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Deformable shape recovery by factorization based on a spatiotemporal measurement matrix
Computer Vision and Image Understanding
Modeling, Tracking and Interactive Animation of Faces and Heads Using Input from Video
CA '96 Proceedings of the Computer Animation
Non-Rigid Structure from Motion using non-Parametric Tracking and Non-Linear Optimization
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 1 - Volume 01
Convex optimization for nonrigid stereo reconstruction
IEEE Transactions on Image Processing
5D motion subspaces for planar motions
ECCV'10 Proceedings of the 11th European conference on computer vision conference on Computer vision: Part III
A unified view on deformable shape factorizations
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
Direct Model-Based Tracking of 3D Object Deformations in Depth and Color Video
International Journal of Computer Vision
Multilinear Factorizations for Multi-Camera Rigid Structure from Motion Problems
International Journal of Computer Vision
| Hi-index | 0.00 |
In this paper we address the problem of recovering 3D non-rigid structure from a sequence of images taken with a stereo pair. We have extended existing non-rigid factorization algorithms to the stereo camera case and presented an algorithm to decompose the measurement matrix into the motion of the left and right cameras and the 3D shape, represented as a linear combination of basis-shapes. The added constraints in the stereo camera case are that both cameras are viewing the same structure and that the relative orientation between both cameras is fixed. Our focus in this paper is on the recovery of flexible 3D shape rather than on the correspondence problem. We propose a method to compute reliable 3D models of deformable structure from stereo images. Our experiments with real data show that improved reconstructions can be achieved using this method. The algorithm includes a non-linear optimization step that minimizes image reprojection error and imposes the correct structure to the motion matrix by choosing an appropriate parameterization. We show that 3D shape and motion estimates can be successfully disambiguated after bundle adjustment and demonstrate this on synthetic and real image sequences. While this optimization step is proposed for the stereo camera case, it can be readily applied to the case of non-rigid structure recovery using a monocular video sequence.