Human body shape and motion tracking by hierarchical weighted ICP

Authors:
Jia Chen;Xiaojun Wu;Michael Yu Wang;Fuqin Deng
Affiliations:
Shenzhen Graduate School, Harbin Institute of Technology, Shenzhen, China;Shenzhen Graduate School, Harbin Institute of Technology, Shenzhen, China;The Chinese University of Hong Kong, Hong Kong, China;The University of Hong Kong, Hong Kong, China
Venue:
ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part II
Year:
2011

Citing 11
Cited 0

Joint-dependent local deformations for hand animation and object grasping

Proceedings on Graphics interface '88
A Method for Registration of 3-D Shapes

IEEE Transactions on Pattern Analysis and Machine Intelligence - Special issue on interpretation of 3-D scenes—part II
Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
The Visual Hull Concept for Silhouette-Based Image Understanding

IEEE Transactions on Pattern Analysis and Machine Intelligence
Full Body Tracking from Multiple Views Using Stochastic Sampling

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
A survey of advances in vision-based human motion capture and analysis

Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
3D Skeleton-Based Body Pose Recovery

3DPVT '06 Proceedings of the Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06)
Vision-based human motion analysis: An overview

Computer Vision and Image Understanding
Tracking Human Motion with Multiple Cameras Using an Articulated Model

MIRAGE '09 Proceedings of the 4th International Conference on Computer Vision/Computer Graphics CollaborationTechniques
Markerless Motion Capture through Visual Hull, Articulated ICP and Subject Specific Model Generation

International Journal of Computer Vision
Optimization and Filtering for Human Motion Capture

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a new approach for tracking both the human body shape and the whole body motion with complete six DOF of each body limb without imposing rotation or translation constraints. First, a surface mesh with highly improved quality is obtained by using our new silhouette-based visual hull reconstruction method for each frame of multi-view videos. Then, a skinned mesh model is fitted to the data using hierarchical weighted ICP (HWICP) algorithm, where an easy-toadjust strategy for selecting the set of ICP registration points is given based on the weights of the skinned model and the Approximate Nearest Neighbors (ANN) method is applied for fast searching nearest neighbors. By comparing HWICP with the general hierarchical ICP (Iterative Closest Point) method based on synthetic data, we demonstrate the power of weighting corresponding point pairs in HWICP, especially when adjacent body segments of target are near 'cylindrical-shaped'.