Human shape reconstruction via graph cuts for voxel-based markerless motion capture in intelligent environment

Authors:
Masamichi Shimosaka;Kazuhiko Murasaki;Taketoshi Mori;Tomomasa Sato
Affiliations:
The University of Tokyo, Bunkyo-ku, Tokyo, Japan;The University of Tokyo, Bunkyo-ku, Tokyo, Japan;The University of Tokyo, Bunkyo-ku, Tokyo, Japan;The University of Tokyo, Bunkyo-ku, Tokyo, Japan
Venue:
Proceedings of the 3rd International Universal Communication Symposium
Year:
2009

Citing 9
Cited 0

How Far 3D Shapes Can Be Understood from 2D Silhouettes

IEEE Transactions on Pattern Analysis and Machine Intelligence
An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Multilevel Banded Graph Cuts Method for Fast Image Segmentation

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Nearest-Neighbor Methods in Learning and Vision: Theory and Practice (Neural Information Processing)

Nearest-Neighbor Methods in Learning and Vision: Theory and Practice (Neural Information Processing)
Detecting Carried Objects in Short Video Sequences

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part III
3D voxel based online human pose estimation via robust and efficient hashing

ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation
3D human pose from silhouettes by relevance vector regression

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Image segmentation in video sequences: a probabilistic approach

UAI'97 Proceedings of the Thirteenth conference on Uncertainty in artificial intelligence
Background cut

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a robust and real-time 3D human shape reconstruction method in daily life spaces to make practical voxel-based motion capture systems. Our algorithm extracts human silhouette and reconstructs human shape via volume intersection from multi view point images. The method presented in this paper is based on energy minimization via graph cuts, and its main features are: 1) to reduce the background subtraction errors caused by background clutter, 2) to have robustness for influences of shadows, 3) to segment the foreground region even if moving objects other than human. The precise human shape reconstructed by the method improves the accuracy of human pose estimation. Especially, 3) leads to enhance the range of application of the voxel-based human pose estimation. We demonstrate the effectiveness of our approach in terms of both quantitative and qualitative performance where strong shadows appear and moving objects are present in intelligent environment.