Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Retargetting motion to new characters
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Unstructured lumigraph rendering
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Controlled animation of video sprites
Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
Free-viewpoint video of human actors
ACM SIGGRAPH 2003 Papers
Constructing Virtual Worlds Using Dense Stereo
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Visual hull construction, alignment and refinement for human kinematic modeling, motion tracking and rendering
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
Rendering Deformable Surface Reflectance Fields
IEEE Transactions on Visualization and Computer Graphics
High performance imaging using large camera arrays
ACM SIGGRAPH 2005 Papers
Video-based character animation
Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation
Image deformation using moving least squares
ACM SIGGRAPH 2006 Papers
The Visual Computer: International Journal of Computer Graphics
Character animation from 2D pictures and 3D motion data
ACM Transactions on Graphics (TOG)
Automatic rigging and animation of 3D characters
ACM SIGGRAPH 2007 papers
Data-driven enhancement of facial attractiveness
ACM SIGGRAPH 2008 papers
Articulated mesh animation from multi-view silhouettes
ACM SIGGRAPH 2008 papers
Performance capture from sparse multi-view video
ACM SIGGRAPH 2008 papers
ACM SIGGRAPH 2008 papers
Proceedings of the 2009 symposium on Interactive 3D graphics and games
Dynamic shape capture using multi-view photometric stereo
ACM SIGGRAPH Asia 2009 papers
Unstructured video-based rendering: interactive exploration of casually captured videos
ACM SIGGRAPH 2010 papers
Parametric reshaping of human bodies in images
ACM SIGGRAPH 2010 papers
Video-based reconstruction of animatable human characters
ACM SIGGRAPH Asia 2010 papers
A practical appearance model for dynamic facial color
ACM SIGGRAPH Asia 2010 papers
MovieReshape: tracking and reshaping of humans in videos
ACM SIGGRAPH Asia 2010 papers
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
Relighting human locomotion with flowed reflectance fields
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
Choreographing amateur performers using video examples
SIGGRAPH Asia 2011 Posters
4D parametric motion graphs for interactive animation
I3D '12 Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
Parametric control of captured mesh sequences for real-time animation
MIG'11 Proceedings of the 4th international conference on Motion in Games
Parametric animation of performance-captured mesh sequences
Computer Animation and Virtual Worlds
A tai chi training system based on fast skeleton matching algorithm
ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part III
VEA 2012: Interactive image/video retexturing using GPU parallelism
Computers and Graphics
Image-based clothes animation for virtual fitting
SIGGRAPH Asia 2012 Technical Briefs
Hi-index | 0.00 |
We present a method to synthesize plausible video sequences of humans according to user-defined body motions and viewpoints. We first capture a small database of multi-view video sequences of an actor performing various basic motions. This database needs to be captured only once and serves as the input to our synthesis algorithm. We then apply a marker-less model-based performance capture approach to the entire database to obtain pose and geometry of the actor in each database frame. To create novel video sequences of the actor from the database, a user animates a 3D human skeleton with novel motion and viewpoints. Our technique then synthesizes a realistic video sequence of the actor performing the specified motion based only on the initial database. The first key component of our approach is a new efficient retrieval strategy to find appropriate spatio-temporally coherent database frames from which to synthesize target video frames. The second key component is a warping-based texture synthesis approach that uses the retrieved most-similar database frames to synthesize spatio-temporally coherent target video frames. For instance, this enables us to easily create video sequences of actors performing dangerous stunts without them being placed in harm's way. We show through a variety of result videos and a user study that we can synthesize realistic videos of people, even if the target motions and camera views are different from the database content.