Least Committed Splines in 3D Modelling of Free Form Objects from Intensity Images

  • Authors:
  • Kuntal Sengupta;Prabir Burman;Sumit Gupta

  • Affiliations:
  • Department of Electrical Engineering, National University of Singapore, 10 Kent Ridge Crescent, Singapore 119260, Republic of Singapore. eleks@nus.edu.sg;Department of Statistics, 380 Kerr Hall, University of California, One Shields Avenue, Davis, CA 95616, USA. pburman@ucdavis.edu;Department of Electrical Engineering, National University of Singapore, 10 Kent Ridge Crescent, Singapore 119260, Republic of Singapore. engp9763@nus.edu.sg

  • Venue:
  • Journal of Mathematical Imaging and Vision
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

Generating 3D models of objects from video sequences is an important problem in many multimedia applications ranging from teleconferencing to virtual reality. In this paper, we present a method of estimating the 3D face model from a monocular image sequence, using a few standard results from the affine camera geometry literature in computer vision, and spline fitting techniques using a modified non parametric regression technique. We use the bicubic spline functions to model the depth map, given a set of observation depth maps computed from frame pairs in a video sequence. The minimal number of splines are chosen on the basis of the Schwartz's Criterion. We extend the spline fitting algorithm to hierarchical splines. Note that the camera calibration parameters and the prior knowledge of the object shape is not required by the algorithm. The system has been successfully demonstrated to extract 3D face structure of humans as well as other objects, starting from their image sequences.