Shape and motion from image streams under orthography: a factorization method
International Journal of Computer Vision
Rank-deficient and discrete ill-posed problems: numerical aspects of linear inversion
Rank-deficient and discrete ill-posed problems: numerical aspects of linear inversion
An Adaptive-Focus Deformable Model Using Statistical and Geometric Information
IEEE Transactions on Pattern Analysis and Machine Intelligence
A Direct Method for 3D Factorization of Nonrigid Motion Observed in 2D
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Simultaneous Registration and Modeling of Deformable Shapes
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Nonrigid Structure-from-Motion: Estimating Shape and Motion with Hierarchical Priors
IEEE Transactions on Pattern Analysis and Machine Intelligence
Estimating 3D shape from degenerate sequences with missing data
Computer Vision and Image Understanding
Real-time combined 2D+3D active appearance models
CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Adaptive Non-rigid Registration and Structure from Motion from Image Trajectories
International Journal of Computer Vision
| Hi-index | 0.00 |
This paper addresses the problem of registering a 3D model, represented as a cloud of points lying over a surface, to a set of 2D deforming image trajectories in the image plane. The proposed approach can adapt to a scenario where the 3D model to register is not an exact description of the measured image data. This results in finding the best 2D-3D registration, given the complexity of having both 2D deforming data and a coarse description of the image observations. The method acts in two distinct phases. First, an affine step computes a factorization for both the 2D image data and the 3D model using a joint subspace decomposition. This initial solution is then upgraded by finding the best projection to the image plane complying with the metric constraints given by a scaled orthographic camera. Both steps are computed efficiently in closed-form with the additional feature of being robust to degenerate motions which may possibly affect the 2D image data (i.e. lack of relevant rigid motion). Moreover, we present an extension of the approach for the case of missing image data. Synthetic and real experiments show the robustness of the method in registration tasks such as pose estimation of a talking face using a single 3D model.