Numerical recipes in C: the art of scientific computing
Numerical recipes in C: the art of scientific computing
Visual tracking of high DOF articulated structures: an application to human hand tracking
ECCV '94 Proceedings of the third European conference on Computer Vision (Vol. II)
Elastic-Model Driven Analysis of Several Views of a Deformable Cylindrical Object
IEEE Transactions on Pattern Analysis and Machine Intelligence
Frequency-Based Nonrigid Motion Analysis: Application to Four Dimensional Medical Images
IEEE Transactions on Pattern Analysis and Machine Intelligence
Efficient nonlinear finite element modeling of nonrigid objects via optimization of mesh models
Computer Vision and Image Understanding - Special issue on CAD-based computer vision
Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis
IEEE Transactions on Pattern Analysis and Machine Intelligence
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Adaptive shape evolution using blending
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Model-based tracking of self-occluding articulated objects
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Vision based hand modeling and tracking for virtual teleconferencing and telecollaboration
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
A Three-Dimensional Model of Human Lip Motions Trained from Video
NAM '97 Proceedings of the 1997 IEEE Workshop on Motion of Non-Rigid and Articulated Objects (NAM '97)
Human Motion Analysis: A Review
NAM '97 Proceedings of the 1997 IEEE Workshop on Motion of Non-Rigid and Articulated Objects (NAM '97)
Gesture-tracking in real time with dynamic regional range computation
Real-Time Imaging
A Framework for Model-Based Tracking Experiments in Image Sequences
International Journal of Computer Vision
Monocular 3-D tracking of inextensible deformable surfaces under L2-norm
IEEE Transactions on Image Processing
Retexturing single views using texture and shading
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part IV
Hi-index | 0.14 |
In this paper, we propose new algorithms for accurate nonrigid motion tracking. Given an initial model representing general knowledge of the object, a set of sparse correspondences, and incomplete or missing information about geometry or material properties, we can recover dense motion vectors using finite element models. The method is based on the iterative analysis of the differences between the actual and predicted behavior. Large differences indicate that an object's properties are not captured properly by the model describing it. Feedback from the images during the motion allows the refinement of the model by minimizing the error between the expected and true position of the object's points. These errors are due to flaws in the model parameter estimation such as geometry and material properties. Unknown parameters are recovered using an iterative descent search for the best nonlinear finite element model that approximates nonrigid motion of the given object. During this search process, we not only estimate material properties, but also infer dense point correspondences from our initial set of sparse correspondences. Thus, during tracking, the model is refined which, in turn, improves tracking quality. As a result, we obtain a more precise description of nonrigid motion. Experimental results demonstrate the success of the proposed algorithm. The method was applied to man-made elastic materials and human skin to recover unknown elasticity, to complex 3D objects to find details of their geometry, and to a hand motion analysis application. Our work demonstrates the possibility of accurate quantitative analysis of nonrigid motion in range image sequences with objects consisting of multiple materials and 3D volumes.