Modelling nonrigid object from video sequence under perspective projection

Authors:
Guanghui Wang;Yantao Tian;Guoqiang Sun
Affiliations:
Department of Control Engineering, Aviation University of Airforce, Changchun, P.R. China;School of Communication Engineering, Jilin University, Changchun, China;Department of Control Engineering, Aviation University of Airforce, Changchun, P.R. China
Venue:
ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
Year:
2005

Citing 8
Cited 1

Shape and motion from image streams under orthography: a factorization method

International Journal of Computer Vision
Euclidean Shape and Motion from Multiple Perspective Views by Affine Iterations

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Paraperspective Factorization Method for Shape and Motion Recovery

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Multibody Factorization Method for Independently Moving Objects

International Journal of Computer Vision
Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters

International Journal of Computer Vision - 1998 Marr Prize
Multiple view geometry in computer visiond

Multiple view geometry in computer visiond
Factorization Methods for Projective Structure and Motion

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Separability of Pose and Expression in Facial Tracking and Animation

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision

Rotation constrained power factorization for structure from motion of nonrigid objects

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

The paper is focused on the problem of estimating 3D structure and motion of nonrigid object from a monocular video sequence. Many previous methods on this problem utilize the extension technique of factorization based on rank constraint to the tracking matrix, where the 3D shape of nonrigid object is expressed as weighted combination of a set of shape bases. All these solutions are based on the assumption of affine camera model. This assumption will become invalid and cause large reconstruction errors when the object is close to the camera. The main contribution of this paper is that we extend these methods to the general perspective camera model. The proposed algorithm iteratively updates the shape and motion from weak perspective projection to fully perspective projection by refining the scalars corresponding to the projective depths. Extensive experiments on real sequences validate the effectiveness and improvements of the proposed method.