Hyperpatches for 3D Model Acquisition and Tracking

Authors:
Charles S. Wiles;Atsuto Maki;Natsuko Matsuda
Affiliations:
Anthropics Technology, London, UK;Toshiba Corp. Research and Development Center, Kawasaki, Japan;Jungle Inc., Tokyo, Japan
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2001

Citing 17
Cited 10

Recognizing solid objects by alignment with an image

International Journal of Computer Vision
Shape and motion from image streams under orthography: a factorization method

International Journal of Computer Vision
Geometry and photometry in three-dimensional visual recognition

Geometry and photometry in three-dimensional visual recognition
Three-dimensional computer vision: a geometric viewpoint

Three-dimensional computer vision: a geometric viewpoint
Face recognition: the problem of compensating for changes in illumination direction

ECCV '94 Proceedings of the third European conference on Computer vision (vol. 1)
Direct computation of shape cues using scale-adapted spatial derivative operators

International Journal of Computer Vision - Special issue: machine vision research at the Royal Institute of Technology
Efficient Region Tracking With Parametric Models of Geometry and Illumination

IEEE Transactions on Pattern Analysis and Machine Intelligence
What Is the Set of Images of an Object Under All Possible Illumination Conditions?

International Journal of Computer Vision
CONDENSATION—Conditional Density Propagation forVisual Tracking

International Journal of Computer Vision
A Multibody Factorization Method for Independently Moving Objects

International Journal of Computer Vision
Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Learning Dynamics of Complex Motions from Image Sequences

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume I - Volume I
EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume I - Volume I
3D Model Acquisition from Extended Image Sequences

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume II - Volume II
Motion Regularization for Model-Based Head Tracking

ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
Geotensity: Combining Motion and Lighting for 3D Surface Reconstruction

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision

Geotensity: Combining Motion and Lighting for 3D Surface Reconstruction

International Journal of Computer Vision
Constructing Illumination Image Basis from Object Motion

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part III
Shape and appearance models of talking faces for model-based tracking

AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
Basic theoretical results for expert systems. Application to the supervision of adaptation transients in planar robots

Artificial Intelligence
Mimicking video: real-time morphable 3D model fitting

Proceedings of the ACM symposium on Virtual reality software and technology
Real-Time Gesture Recognition by Learning and Selective Control of Visual Interest Points

IEEE Transactions on Pattern Analysis and Machine Intelligence
Facial expression recognition system based on rigid and non-rigid motion separation and 3D pose estimation

Pattern Recognition
From rendering to tracking point-based 3D models

Image and Vision Computing
A graphical model based solution to the facial feature point tracking problem

Image and Vision Computing
3D surface reconstruction of a moving object in the presence of specular reflection

ICIAP'05 Proceedings of the 13th international conference on Image Analysis and Processing

Quantified Score

Hi-index	0.14

Visualization

Abstract

Automatic 3D model acquisition and 3D tracking of simple objects under motion using a single camera is often difficult due to the sparsity of information from which to establish the model. We have developed an automatic scheme that first computes a simple pointalistic Euclidean model of the object and then enriches this model using hyperpatches. These hyperpatches contain information on both the orientation and intensity pattern variation of roughly planar patches on an object. This information allows both the spatial and intensity distortions of the projected patch to be modeled accurately under 3D object motion. Considering human tracking as a specific application, we show that hyperpatches can not only be computed automatically during model acquisition from a monocular image sequence, but that they are also extremely appropriate for the task of visual tracking.