A Computational Approach to Edge Detection
IEEE Transactions on Pattern Analysis and Machine Intelligence
Model-based tracking of self-occluding articulated objects
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Tracking Articulated Hand Motion with Eigen Dynamics Analysis
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Physically based grasping control from example
Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation
Helping hand: an anatomically accurate inverse dynamics solution for unconstrained hand motion
Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation
Interaction capture and synthesis
ACM SIGGRAPH 2006 Papers
Musculotendon simulation for hand animation
ACM SIGGRAPH 2008 papers
Dextrous manipulation from a grasping pose
ACM SIGGRAPH 2009 papers
Real-time hand-tracking with a color glove
ACM SIGGRAPH 2009 papers
Synthesis of interactive hand manipulation
Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
VideoMocap: modeling physically realistic human motion from monocular video sequences
ACM SIGGRAPH 2010 papers
Sampling-based contact-rich motion control
ACM SIGGRAPH 2010 papers
Model-Based 3D Hand Pose Estimation from Monocular Video
IEEE Transactions on Pattern Analysis and Machine Intelligence
Super-Gaussian mixture source model for ICA
ICA'06 Proceedings of the 6th international conference on Independent Component Analysis and Blind Signal Separation
Sleight of hand: perception of finger motion from reduced marker sets
I3D '12 Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
Video-based 3D motion capture through biped control
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Synthesis of detailed hand manipulations using contact sampling
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Motion capture of hands in action using discriminative salient points
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
Combining marker-based mocap and RGB-D camera for acquiring high-fidelity hand motion data
EUROSCA'12 Proceedings of the 11th ACM SIGGRAPH / Eurographics conference on Computer Animation
Robust realtime physics-based motion control for human grasping
ACM Transactions on Graphics (TOG)
| Hi-index | 0.00 |
This paper describes a new method for acquiring physically realistic hand manipulation data from multiple video streams. The key idea of our approach is to introduce a composite motion control to simultaneously model hand articulation, object movement, and subtle interaction between the hand and object. We formulate video-based hand manipulation capture in an optimization framework by maximizing the consistency between the simulated motion and the observed image data. We search an optimal motion control that drives the simulation to best match the observed image data. We demonstrate the effectiveness of our approach by capturing a wide range of high-fidelity dexterous manipulation data. We show the power of our recovered motion controllers by adapting the captured motion data to new objects with different properties. The system achieves superior performance against alternative methods such as marker-based motion capture and kinematic hand motion tracking.