Deformation weight constraint and 3D reconstruction of nonrigid objects

  • Authors:

  • Guanghui Wang;Q. M. Jonathan Wu

  • Affiliations:

  • Department of Electrical and Computer Engineering, The University of Windsor, Windsor, Ontario, Canada and National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of S ...;Department of Electrical and Computer Engineering, The University of Windsor, Windsor, Ontario, Canada

  • Venue:
  • ICIAR'07 Proceedings of the 4th international conference on Image Analysis and Recognition
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

The problem of 3D reconstruction of nonrigid objects from uncalibrated image sequences is addressed in the paper. Our method assumes that the nonrigid object is composed of rigid part and deformation part. We first recover the affine structure of the object and separate the rigid features from the deformation ones. Then stratify the structure from affine to Euclidean space by virtue of the rigid features. The novelty of the paper lies in two aspects. First, we propose a deformation weight constraint to the problem and prove that the recovered shape bases and shapes are transformation invariant under this constraint. Second, we propose a constrained power factorization (CPF) algorithm to recover the deformation structure in affine space. The algorithm overcomes the limitations of previous SVD-based methods and can work with missing data in the tracking matrix. Extensive experiments on synthetic data and real sequences validate the proposed method and show improvements over existing solutions.