Virtualized reality: constructing time-varying virtual worlds from real world events
VIS '97 Proceedings of the 8th conference on Visualization '97
The digital Michelangelo project: 3D scanning of large statues
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Articulated body deformation from range scan data
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization
SIAM Journal on Optimization
Combining 2D Feature Tracking and Volume Reconstruction for Online Video-Based Human Motion Capture
PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
Free-viewpoint video of human actors
ACM SIGGRAPH 2003 Papers
Continuous capture of skin deformation
ACM SIGGRAPH 2003 Papers
Differential Coordinates for Interactive Mesh Editing
SMI '04 Proceedings of the Shape Modeling International 2004
Deformation transfer for triangle meshes
ACM SIGGRAPH 2004 Papers
M^3: Marker-Free Model Reconstruction and Motion Tracking from 3D Voxel Data
PG '04 Proceedings of the Computer Graphics and Applications, 12th Pacific Conference
Visual Hull Construction Using Adaptive Sampling
WACV-MOTION '05 Proceedings of the Seventh IEEE Workshops on Application of Computer Vision (WACV/MOTION'05) - Volume 1 - Volume 01
Silhouette and stereo fusion for 3D object modeling
Computer Vision and Image Understanding - Model-based and image-based 3D scene representation for interactive visalization
International Journal of Computer Vision
SCAPE: shape completion and animation of people
ACM SIGGRAPH 2005 Papers
Capturing and animating skin deformation in human motion
ACM SIGGRAPH 2006 Papers
Editing arbitrarily deforming surface animations
ACM SIGGRAPH 2006 Papers
A convenient multicamera self-calibration for virtual environments
Presence: Teleoperators and Virtual Environments
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
3D Skeleton-Based Body Pose Recovery
3DPVT '06 Proceedings of the Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06)
Surface Capture for Performance-Based Animation
IEEE Computer Graphics and Applications
Seeing People in Different Light-Joint Shape, Motion, and Reflectance Capture
IEEE Transactions on Visualization and Computer Graphics
Weighted Minimal Hypersurface Reconstruction
IEEE Transactions on Pattern Analysis and Machine Intelligence
Capturing and animating occluded cloth
ACM SIGGRAPH 2007 papers
Automatic rigging and animation of 3D characters
ACM SIGGRAPH 2007 papers
Real-time enveloping with rotational regression
ACM SIGGRAPH 2007 papers
Carved visual hulls for image-based modeling
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
Time-resolved 3d capture of non-stationary gas flows
ACM SIGGRAPH Asia 2008 papers
Objective quality assessment in free-viewpoint video production
Image Communication
Video-Based Motion Capturing for Skeleton-Based 3D Models
PSIVT '09 Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video Technology
ACM SIGGRAPH 2009 papers
Technical Section: Estimating body shape of dressed humans
Computers and Graphics
Surface motion graphs for character animation from 3D video
SIGGRAPH 2009: Talks
Dynamic shape capture using multi-view photometric stereo
ACM SIGGRAPH Asia 2009 papers
Robust single-view geometry and motion reconstruction
ACM SIGGRAPH Asia 2009 papers
Focused Volumetric Visual Hull with Color Extraction
ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part II
A euclidean-geodesic shape distribution for retrieval of time-varying mesh sequences
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
International Journal of Computer Vision
A concise and provably informative multi-scale signature based on heat diffusion
SGP '09 Proceedings of the Symposium on Geometry Processing
envyLight: an interface for editing natural illumination
ACM SIGGRAPH 2010 papers
Unstructured video-based rendering: interactive exploration of casually captured videos
ACM SIGGRAPH 2010 papers
Parametric reshaping of human bodies in images
ACM SIGGRAPH 2010 papers
A quality controllable multi-view object reconstruction method for 3D imaging systems
Journal of Visual Communication and Image Representation
Shape Similarity for 3D Video Sequences of People
International Journal of Computer Vision
Video-based reconstruction of animatable human characters
ACM SIGGRAPH Asia 2010 papers
MovieReshape: tracking and reshaping of humans in videos
ACM SIGGRAPH Asia 2010 papers
Computational highlight holography
ACM SIGGRAPH Asia 2010 papers
Skeleton and shape adjustment and tracking in multicamera environments
AMDO'10 Proceedings of the 6th international conference on Articulated motion and deformable objects
Probabilistic deformable surface tracking from multiple videos
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Region-of-interest volumetric visual hull refinement
Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology
Conversion of performance mesh animation into cage-based animation
ACM SIGGRAPH ASIA 2010 Posters
Video-based characters: creating new human performances from a multi-view video database
ACM SIGGRAPH 2011 papers
Colour dynamic photometric stereo for textured surfaces
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part II
Cage-based tracking for performance animation
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
Global registration of dynamic range scans for articulated model reconstruction
ACM Transactions on Graphics (TOG)
Interactively Co-segmentating Topically Related Images with Intelligent Scribble Guidance
International Journal of Computer Vision
3D Archive System for Traditional Performing Arts
International Journal of Computer Vision
Controllable hand deformation from sparse examples with rich details
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Pose-consistent 3D shape segmentation based on a quantum mechanical feature descriptor
DAGM'11 Proceedings of the 33rd international conference on Pattern recognition
Modeling 3D articulated motions with conformal geometry videos (CGVs)
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Temporally coherent completion of dynamic shapes
ACM Transactions on Graphics (TOG)
Video-based toon character from surface performance capture
SIGGRAPH Asia 2011 Sketches
Free viewpoint virtual try-on with commodity depth cameras
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
Gaussian process motion graph models for smooth transitions among multiple actions
Computer Vision and Image Understanding
Globally optimal spatio-temporal reconstruction from cluttered videos
ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
4D parametric motion graphs for interactive animation
I3D '12 Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
Dense and accurate spatio-temporal multi-view stereovision
ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part II
Parametric control of captured mesh sequences for real-time animation
MIG'11 Proceedings of the 4th international conference on Motion in Games
3D reconstruction and video-based rendering of casually captured videos
Proceedings of the 2010 international conference on Video Processing and Computational Video
Parametric animation of performance-captured mesh sequences
Computer Animation and Virtual Worlds
3D Human model adaptation by frame selection and shape-texture optimization
Computer Vision and Image Understanding
Detail-aware spatial deformation transfer
Computer Animation and Virtual Worlds
Novel-View Synthesis of Outdoor Sport Events Using an Adaptive View-Dependent Geometry
Computer Graphics Forum
Iterative cage-based registration for dynamic shape capture
ACM SIGGRAPH 2012 Posters
Data-driven simulation methods in computer graphics: cloth, tissue and faces
ACM SIGGRAPH 2012 Courses
Non-rigid 3D shape tracking from multiview video
Computer Vision and Image Understanding
KinÊtre: animating the world with the human body
Proceedings of the 25th annual ACM symposium on User interface software and technology
Bendylights: artistic control of direct illumination by curving light rays
EGSR'10 Proceedings of the 21st Eurographics conference on Rendering
State of the Art Report on Video-Based Graphics and Video Visualization
Computer Graphics Forum
Performance Capture of High-Speed Motion Using Staggered Multi-View Recording
Computer Graphics Forum
Improved reconstruction of deforming surfaces by cancelling ambient occlusion
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
Simultaneous shape and pose adaption of articulated models using linear optimization
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
Performance capture of interacting characters with handheld kinects
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Towards optimal non-rigid surface tracking
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Full body performance capture under uncontrolled and varying illumination: a shading-based approach
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
On the evaluation of scene flow estimation
ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume 2
A time series 3D hierarchy for real-time dynamic point cloud interaction
SIGGRAPH Asia 2012 Technical Briefs
Content-aware exaggerated editing for life-like captured animations
Proceedings of the 9th European Conference on Visual Media Production
Controlling liquids using meshes
EUROSCA'12 Proceedings of the 11th ACM SIGGRAPH / Eurographics conference on Computer Animation
Controlling liquids using meshes
Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation
iModel: interactive co-segmentation for object of interest 3d modeling
ECCV'10 Proceedings of the 11th European conference on Trends and Topics in Computer Vision - Volume Part II
Analyzing and evaluating markerless motion tracking using inertial sensors
ECCV'10 Proceedings of the 11th European conference on Trends and Topics in Computer Vision - Volume Part I
Global Non-rigid Alignment of Surface Sequences
International Journal of Computer Vision
Two-layer sparse compression of dense-weight blend skinning
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Invariant surface-based shape descriptor for dynamic surface encoding
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part I
Simultaneous particle tracking in multi-action motion models with synthesized paths
Image and Vision Computing
Analyzing growing plants from 4D point cloud data
ACM Transactions on Graphics (TOG)
On-set performance capture of multiple actors with a stereo camera
ACM Transactions on Graphics (TOG)
Cooperative estimation of human motion and surfaces using multiview videos
Computer Vision and Image Understanding
Iterative cage-based registration from multi-view silhouettes
Proceedings of the 10th European Conference on Visual Media Production
Genetic programming extension to APF-based monocular human body pose estimation
Multimedia Tools and Applications
Special Section on CAD/Graphics 2013: SCAPE-based human performance reconstruction
Computers and Graphics
3D human motion analysis framework for shape similarity and retrieval
Image and Vision Computing
Estimating scene flow using an interconnected patch surface model with belief-propagation inference
Computer Vision and Image Understanding
Animation-aware quadrangulation
SGP '13 Proceedings of the Eleventh Eurographics/ACMSIGGRAPH Symposium on Geometry Processing
Hi-index | 0.00 |
Details in mesh animations are difficult to generate but they have great impact on visual quality. In this work, we demonstrate a practical software system for capturing such details from multi-view video recordings. Given a stream of synchronized video images that record a human performance from multiple viewpoints and an articulated template of the performer, our system captures the motion of both the skeleton and the shape. The output mesh animation is enhanced with the details observed in the image silhouettes. For example, a performance in casual loose-fitting clothes will generate mesh animations with flowing garment motions. We accomplish this with a fast pose tracking method followed by nonrigid deformation of the template to fit the silhouettes. The entire process takes less than sixteen seconds per frame and requires no markers or texture cues. Captured meshes are in full correspondence making them readily usable for editing operations including texturing, deformation transfer, and deformation model learning.