A limited memory algorithm for bound constrained optimization
SIAM Journal on Scientific Computing
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
Understanding Motion Capture for Computer Animation and Video Games
Understanding Motion Capture for Computer Animation and Video Games
Articulated body deformation from range scan data
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Object Recognition from Local Scale-Invariant Features
ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Free-viewpoint video of human actors
ACM SIGGRAPH 2003 Papers
Continuous capture of skin deformation
ACM SIGGRAPH 2003 Papers
blue-c: a spatially immersive display and 3D video portal for telepresence
ACM SIGGRAPH 2003 Papers
Deformation transfer for triangle meshes
ACM SIGGRAPH 2004 Papers
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
Unifying Measured Point Sequences of Deforming Objects
3DPVT '04 Proceedings of the 3D Data Processing, Visualization, and Transmission, 2nd International Symposium
Image-based spatio-temporal modeling and view interpolation of dynamic events
ACM Transactions on Graphics (TOG)
High performance imaging using large camera arrays
ACM SIGGRAPH 2005 Papers
A Spectral Technique for Correspondence Problems Using Pairwise Constraints
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Capturing and animating skin deformation in human motion
ACM SIGGRAPH 2006 Papers
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Garment motion capture using color-coded patterns
SIGGRAPH '05 ACM SIGGRAPH 2005 Sketches
A survey of advances in vision-based human motion capture and analysis
Computer Vision and Image Understanding - Special issue on modeling people: Vision-based understanding of a person's shape, appearance, movement, and behaviour
Surface Capture for Performance-Based Animation
IEEE Computer Graphics and Applications
Multi-scale capture of facial geometry and motion
ACM SIGGRAPH 2007 papers
Capturing and animating occluded cloth
ACM SIGGRAPH 2007 papers
Gradient domain editing of deforming mesh sequences
ACM SIGGRAPH 2007 papers
Poisson surface reconstruction
SGP '06 Proceedings of the fourth Eurographics symposium on Geometry processing
Reconstruction of deforming geometry from time-varying point clouds
SGP '07 Proceedings of the fifth Eurographics symposium on Geometry processing
As-rigid-as-possible surface modeling
SGP '07 Proceedings of the fifth Eurographics symposium on Geometry processing
SGP '07 Proceedings of the fifth Eurographics symposium on Geometry processing
Vision-based human motion analysis: An overview
Computer Vision and Image Understanding
On Linear Variational Surface Deformation Methods
IEEE Transactions on Visualization and Computer Graphics
Marker-less 3D feature tracking for mesh-based human motion capture
Proceedings of the 2nd conference on Human motion: understanding, modeling, capture and animation
Cloth x-ray: mocap of people wearing textiles
DAGM'06 Proceedings of the 28th conference on Pattern Recognition
Relighting human locomotion with flowed reflectance fields
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
Template deformation for point cloud fitting
SPBG'06 Proceedings of the 3rd Eurographics / IEEE VGTC conference on Point-Based Graphics
Time-resolved 3d capture of non-stationary gas flows
ACM SIGGRAPH Asia 2008 papers
Objective quality assessment in free-viewpoint video production
Image Communication
Video-Based Motion Capturing for Skeleton-Based 3D Models
PSIVT '09 Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video Technology
Proceedings of the 2009 symposium on Interactive 3D graphics and games
Efficient reconstruction of nonrigid shape and motion from real-time 3D scanner data
ACM Transactions on Graphics (TOG)
Physically guided liquid surface modeling from videos
ACM SIGGRAPH 2009 papers
Technical Section: Estimating body shape of dressed humans
Computers and Graphics
Surface motion graphs for character animation from 3D video
SIGGRAPH 2009: Talks
Dynamic shape capture using multi-view photometric stereo
ACM SIGGRAPH Asia 2009 papers
Robust single-view geometry and motion reconstruction
ACM SIGGRAPH Asia 2009 papers
Build your own 3D scanner: optical triangulation for beginners
ACM SIGGRAPH ASIA 2009 Courses
ACM SIGGRAPH ASIA 2009 Sketches
Build your own 3D scanner: 3D photography for beginners
ACM SIGGRAPH 2009 Courses
A euclidean-geodesic shape distribution for retrieval of time-varying mesh sequences
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
High resolution passive facial performance capture
ACM SIGGRAPH 2010 papers
Unstructured video-based rendering: interactive exploration of casually captured videos
ACM SIGGRAPH 2010 papers
Parametric reshaping of human bodies in images
ACM SIGGRAPH 2010 papers
A quality controllable multi-view object reconstruction method for 3D imaging systems
Journal of Visual Communication and Image Representation
Shape Similarity for 3D Video Sequences of People
International Journal of Computer Vision
Technical Section: Realistic cloth augmentation in single view video under occlusions
Computers and Graphics
Video-based reconstruction of animatable human characters
ACM SIGGRAPH Asia 2010 papers
MovieReshape: tracking and reshaping of humans in videos
ACM SIGGRAPH Asia 2010 papers
Probabilistic deformable surface tracking from multiple videos
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Collaborative color calibration for multi-camera systems
Image Communication
Coherent image-based rendering of real-world objects
I3D '11 Symposium on Interactive 3D Graphics and Games
A multiple camera system with real-time volume reconstruction for articulated skeleton pose tracking
MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part I
Video-based characters: creating new human performances from a multi-view video database
ACM SIGGRAPH 2011 papers
Gradual sampling and mutual information maximisation for markerless motion capture
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part II
Cage-based tracking for performance animation
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
Reconstructing mass-conserved water surfaces using shape from shading and optical flow
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV
Global registration of dynamic range scans for articulated model reconstruction
ACM Transactions on Graphics (TOG)
3D video and free viewpoint video-From capture to display
Pattern Recognition
3D Archive System for Traditional Performing Arts
International Journal of Computer Vision
A free-viewpoint virtual mirror with marker-less user interaction
SCIA'11 Proceedings of the 17th Scandinavian conference on Image analysis
Controllable hand deformation from sparse examples with rich details
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Human motion reconstruction from force sensors
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
3D reconstruction of detail change on dynamic non-rigid objects
ACM SIGGRAPH 2011 Posters
Temporally coherent completion of dynamic shapes
ACM Transactions on Graphics (TOG)
Free viewpoint virtual try-on with commodity depth cameras
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
Unsupervised Learning for Graph Matching
International Journal of Computer Vision
Globally optimal spatio-temporal reconstruction from cluttered videos
ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
Animation cartography—intrinsic reconstruction of shape and motion
ACM Transactions on Graphics (TOG)
Bilinear spatiotemporal basis models
ACM Transactions on Graphics (TOG)
4D parametric motion graphs for interactive animation
I3D '12 Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
Dense and accurate spatio-temporal multi-view stereovision
ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part II
Parametric control of captured mesh sequences for real-time animation
MIG'11 Proceedings of the 4th international conference on Motion in Games
Towards plenoptic raumzeit reconstruction
Proceedings of the 2010 international conference on Video Processing and Computational Video
3D reconstruction and video-based rendering of casually captured videos
Proceedings of the 2010 international conference on Video Processing and Computational Video
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Stochastic tomography and its applications in 3D imaging of mixing fluids
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Parametric animation of performance-captured mesh sequences
Computer Animation and Virtual Worlds
Novel-View Synthesis of Outdoor Sport Events Using an Adaptive View-Dependent Geometry
Computer Graphics Forum
CageR: from 3D performance capture to cage-based representation
ACM SIGGRAPH 2012 Talks
Data-driven simulation methods in computer graphics: cloth, tissue and faces
ACM SIGGRAPH 2012 Courses
Compression techniques for 3d video mesh sequences
AMDO'12 Proceedings of the 7th international conference on Articulated Motion and Deformable Objects
Non-rigid 3D shape tracking from multiview video
Computer Vision and Image Understanding
CageR: Cage-Based Reverse Engineering of Animated 3D Shapes
Computer Graphics Forum
Performance Capture of High-Speed Motion Using Staggered Multi-View Recording
Computer Graphics Forum
Scale Normalization for Isometric Shape Matching
Computer Graphics Forum
Improved reconstruction of deforming surfaces by cancelling ambient occlusion
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
Simultaneous shape and pose adaption of articulated models using linear optimization
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
3D reconstruction of dynamic scenes with multiple handheld cameras
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Performance capture of interacting characters with handheld kinects
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Full body performance capture under uncontrolled and varying illumination: a shading-based approach
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Content-aware exaggerated editing for life-like captured animations
Proceedings of the 9th European Conference on Visual Media Production
Global Non-rigid Alignment of Surface Sequences
International Journal of Computer Vision
Direct Model-Based Tracking of 3D Object Deformations in Depth and Color Video
International Journal of Computer Vision
Invariant surface-based shape descriptor for dynamic surface encoding
ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part I
Real-time high-resolution sparse voxelization with application to image-based modeling
Proceedings of the 5th High-Performance Graphics Conference
Analyzing growing plants from 4D point cloud data
ACM Transactions on Graphics (TOG)
On-set performance capture of multiple actors with a stereo camera
ACM Transactions on Graphics (TOG)
Iterative cage-based registration from multi-view silhouettes
Proceedings of the 10th European Conference on Visual Media Production
Special Section on CAD/Graphics 2013: SCAPE-based human performance reconstruction
Computers and Graphics
3D human motion analysis framework for shape similarity and retrieval
Image and Vision Computing
Estimating scene flow using an interconnected patch surface model with belief-propagation inference
Computer Vision and Image Understanding
Personalized animatable avatars from depth data
JVRC '13 Proceedings of the 5th Joint Virtual Reality Conference
3D human video retrieval: from pose to motion matching
3DOR '13 Proceedings of the Sixth Eurographics Workshop on 3D Object Retrieval
Hi-index | 0.00 |
This paper proposes a new marker-less approach to capturing human performances from multi-view video. Our algorithm can jointly reconstruct spatio-temporally coherent geometry, motion and textural surface appearance of actors that perform complex and rapid moves. Furthermore, since our algorithm is purely meshbased and makes as few as possible prior assumptions about the type of subject being tracked, it can even capture performances of people wearing wide apparel, such as a dancer wearing a skirt. To serve this purpose our method efficiently and effectively combines the power of surface- and volume-based shape deformation techniques with a new mesh-based analysis-through-synthesis framework. This framework extracts motion constraints from video and makes the laser-scan of the tracked subject mimic the recorded performance. Also small-scale time-varying shape detail is recovered by applying model-guided multi-view stereo to refine the model surface. Our method delivers captured performance data at high level of detail, is highly versatile, and is applicable to many complex types of scenes that could not be handled by alternative marker-based or marker-free recording techniques.