The design and analysis of algorithms
The design and analysis of algorithms
Numerical recipes in C (2nd ed.): the art of scientific computing
Numerical recipes in C (2nd ed.): the art of scientific computing
Three-dimensional computer vision: a geometric viewpoint
Three-dimensional computer vision: a geometric viewpoint
Active shape models—their training and application
Computer Vision and Image Understanding
A volumetric method for building complex models from range images
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
IEEE Transactions on Pattern Analysis and Machine Intelligence
Video Rewrite: driving visual speech with audio
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
3D lip shapes from video: a combined physical-statistical model
Speech Communication - Special issue on auditory-visual speech processing
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
A morphable model for the synthesis of 3D faces
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Controlled animation of video sprites
Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
Trainable videorealistic speech animation
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Motion texture: a two-level statistical model for character motion synthesis
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Interactive control of avatars animated with human motion data
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Adjusting Shape Parameters Using Model-Based Optical Flow Residuals
IEEE Transactions on Pattern Analysis and Machine Intelligence
Computer generated animation of faces
ACM '72 Proceedings of the ACM annual conference - Volume 1
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
International Journal of Computer Vision
A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment
IEEE Transactions on Pattern Analysis and Machine Intelligence
Modeling, Tracking and Interactive Animation of Faces and Heads Using Input from Video
CA '96 Proceedings of the Computer Animation
One-Shot Active 3D Shape Acquisition
ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
Geometry-driven photorealistic facial expression synthesis
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Learning controls for blend shape based realistic facial animation
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Vision-based control of 3D facial animation
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
The space of human body shapes: reconstruction and parameterization from range scans
ACM SIGGRAPH 2003 Papers
Automatic determination of facial muscle activations from sparse motion capture marker data
ACM SIGGRAPH 2005 Papers
Face transfer with multilinear models
ACM SIGGRAPH 2005 Papers
ACM SIGGRAPH 2005 Papers
Performance relighting and reflectance transformation with time-multiplexed illumination
ACM SIGGRAPH 2005 Papers
Real-Time Range Acquisition by Adaptive Structured Light
IEEE Transactions on Pattern Analysis and Machine Intelligence
Capturing and animating skin deformation in human motion
ACM SIGGRAPH 2006 Papers
Projection defocus analysis for scene capture and image display
ACM SIGGRAPH 2006 Papers
Inverse kinematics for reduced deformable models
ACM SIGGRAPH 2006 Papers
Modeling and animating for the dense laser-scanned face in the low resolution level
MS'06 Proceedings of the 17th IASTED international conference on Modelling and simulation
RotoTexture: Automated Tools for Texturing Raw Video
IEEE Transactions on Visualization and Computer Graphics
ACM SIGGRAPH 2006 Courses
ACM SIGGRAPH 2006 Courses
Playable universal capture: compression and real-time sequencing of image-based facial animation
ACM SIGGRAPH 2006 Courses
Face transfer with multilinear models
ACM SIGGRAPH 2006 Courses
SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
Facial animation in a nutshell: past, present and future
SAICSIT '06 Proceedings of the 2006 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries
eFASE: expressive facial animation synthesis and editing with phoneme-isomap controls
Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Simulating speech with a physics-based facial muscle model
Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Sketching articulation and pose for facial animation
Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation
Point-sampled 3D video of real-world scenes
Image Communication
Feature-preserving non-local denoising of static and time-varying range data
Proceedings of the 2007 ACM symposium on Solid and physical modeling
Dynamic, expressive speech animation from a single mesh
SCA '07 Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation
Face poser: interactive modeling of 3D facial expressions using model priors
SCA '07 Proceedings of the 2007 ACM SIGGRAPH/Eurographics symposium on Computer animation
Constraint-based motion optimization using a statistical dynamic model
ACM SIGGRAPH 2007 papers
Multi-scale capture of facial geometry and motion
ACM SIGGRAPH 2007 papers
Facial type, expression, and viseme generation
ACM SIGGRAPH 2007 posters
An image processing approach to surface matching
SGP '05 Proceedings of the third Eurographics symposium on Geometry processing
Reconstruction of deforming geometry from time-varying point clouds
SGP '07 Proceedings of the fifth Eurographics symposium on Geometry processing
EURASIP Journal on Applied Signal Processing
Multiflash Stereopsis: Depth-Edge-Preserving Stereo with Small Baseline Illumination
IEEE Transactions on Pattern Analysis and Machine Intelligence
Proceedings of the 5th international conference on Computer graphics and interactive techniques in Australia and Southeast Asia
High Resolution Tracking of Non-Rigid Motion of Densely Sampled 3D Data Using Harmonic Maps
International Journal of Computer Vision
Hair photobooth: geometric and photometric acquisition of real hairstyles
ACM SIGGRAPH 2008 papers
Real-time data driven deformation using kernel canonical correlation analysis
ACM SIGGRAPH 2008 papers
ACM SIGGRAPH 2008 papers
Model-based human shape reconstruction from multiple views
Computer Vision and Image Understanding
Adaptive feature-preserving non-local denoising of static and time-varying range data
Computer-Aided Design
Projector camera system for realtime 3D scanning
PROCAMS '08 Proceedings of the 5th ACM/IEEE International Workshop on Projector camera systems
Using structured light for efficient depth edge detection
Image and Vision Computing
Space-time surface reconstruction using incompressible flow
ACM SIGGRAPH Asia 2008 papers
Facial performance synthesis using deformation-driven polynomial displacement maps
ACM SIGGRAPH Asia 2008 papers
Video object annotation, navigation, and composition
Proceedings of the 21st annual ACM symposium on User interface software and technology
Efficient reconstruction of nonrigid shape and motion from real-time 3D scanner data
ACM Transactions on Graphics (TOG)
Model-based synthesis of visual speech movements from 3D video
SIGGRAPH '09: Posters
Face/Off: live facial puppetry
Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Style learning and transferring for facial animation editing
Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Proceedings of the 31st DAGM Symposium on Pattern Recognition
Dynamic shape capture using multi-view photometric stereo
ACM SIGGRAPH Asia 2009 papers
Robust single-view geometry and motion reconstruction
ACM SIGGRAPH Asia 2009 papers
Self-organizing approach to moving surface reconstruction
ISCGAV'09 Proceedings of the 9th WSEAS international conference on Signal processing, computational geometry and artificial vision
Pose-space animation and transfer of facial details
Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Perceptually guided expressive facial animation
Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Face poser: Interactive modeling of 3D facial expressions using facial priors
ACM Transactions on Graphics (TOG)
Real-Time Dynamic Wrinkles of Face for Animated Skinned Mesh
ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part II
Reconstruction of Facial Shape from Freehand Multi-viewpoint Snapshots
ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part II
3D facial expression editing based on the dynamic graph model
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Temporal upsampling of performance geometry using photometric alignment
ACM Transactions on Graphics (TOG)
Vision-guided Robot System for Picking Objects by Casting Shadows
International Journal of Robotics Research
Detecting and segmenting un-occluded items by actively casting shadows
ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I
ACM SIGGRAPH 2010 papers
High resolution passive facial performance capture
ACM SIGGRAPH 2010 papers
Low cost virtual face performance capture using stereo web cameras
PSIVT'07 Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Tracking vertex flow and model adaptation for three-dimensional spatiotemporal face analysis
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans - Special issue on recent advances in biometrics
Perception of linear and nonlinear motion properties using a FACS validated 3D facial model
Proceedings of the 7th Symposium on Applied Perception in Graphics and Visualization
Modeling 3D facial expressions using geometry videos
Proceedings of the international conference on Multimedia
Automatic 3D facial model and texture reconstruction from range scans
AMDO'10 Proceedings of the 6th international conference on Articulated motion and deformable objects
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part I
High-resolution object deformation reconstruction with active range camera
Proceedings of the 32nd DAGM conference on Pattern recognition
3D deformable face tracking with a commodity depth camera
ECCV'10 Proceedings of the 11th European conference on computer vision conference on Computer vision: Part III
Efficient computation of scale-space features for deformable shape correspondences
ECCV'10 Proceedings of the 11th European conference on computer vision conference on Computer vision: Part III
Real-time spatiotemporal stereo matching using the dual-cross-bilateral grid
ECCV'10 Proceedings of the 11th European conference on computer vision conference on Computer vision: Part III
Markerless reconstruction and synthesis of dynamic facial expressions
Computer Vision and Image Understanding
Optical signal processing with illumination-encoded filters
Computer Vision and Image Understanding
Expression flow for 3D-aware face component transfer
ACM SIGGRAPH 2011 papers
ACM SIGGRAPH 2011 papers
Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisition
ACM SIGGRAPH 2011 papers
High-quality passive facial performance capture using anchor frames
ACM SIGGRAPH 2011 papers
Interactive region-based linear 3D face models
ACM SIGGRAPH 2011 papers
Realtime performance-based facial animation
ACM SIGGRAPH 2011 papers
Global registration of dynamic range scans for articulated model reconstruction
ACM Transactions on Graphics (TOG)
Controllable hand deformation from sparse examples with rich details
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Multiview face capture using polarized spherical gradient illumination
Proceedings of the 2011 SIGGRAPH Asia Conference
Proceedings of the 2011 SIGGRAPH Asia Conference
Artist friendly facial animation retargeting
Proceedings of the 2011 SIGGRAPH Asia Conference
Compression and direct manipulation of complex blendshape models
Proceedings of the 2011 SIGGRAPH Asia Conference
Temporally coherent completion of dynamic shapes
ACM Transactions on Graphics (TOG)
Layered interpolation for interactive avatar control
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
Real-Time facial expression mapping for high resolution 3d meshes
CGI'06 Proceedings of the 24th international conference on Advances in Computer Graphics
Self-calibrated, Multi-spectral Photometric Stereo for 3D Face Capture
International Journal of Computer Vision
Animation cartography—intrinsic reconstruction of shape and motion
ACM Transactions on Graphics (TOG)
Spacetime expression cloning for blendshapes
ACM Transactions on Graphics (TOG)
A piece-wise learning approach to 3D facial animation
ICWL'07 Proceedings of the 6th international conference on Advances in web based learning
Temporally consistent disparity and optical flow via efficient spatio-temporal filtering
PSIVT'11 Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part I
Tools for placing cuts and transitions in interview video
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Lightweight binocular facial performance capture under uncontrolled lighting
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
An interactive 3D video system for human facial reconstruction and expression modeling
Journal of Visual Communication and Image Representation
Relighting human locomotion with flowed reflectance fields
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
Online expression mapping for performance-driven facial animation
ICEC'07 Proceedings of the 6th international conference on Entertainment Computing
Towards optimal non-rigid surface tracking
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Global Non-rigid Alignment of Surface Sequences
International Journal of Computer Vision
Online modeling for realtime facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
3D shape regression for real-time facial animation
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Realtime facial animation with on-the-fly correctives
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
High fidelity facial animation capture and retargeting with contours
Proceedings of the 12th ACM SIGGRAPH/Eurographics Symposium on Computer Animation
A review of motion analysis methods for human Nonverbal Communication Computing
Image and Vision Computing
Reconstructing detailed dynamic face geometry from monocular video
ACM Transactions on Graphics (TOG)
Sparse localized deformation components
ACM Transactions on Graphics (TOG)
Multi-projector color structured-light vision
Image Communication
Forward non-rigid motion tracking for facial MoCap
The Visual Computer: International Journal of Computer Graphics
| Hi-index | 0.00 |
We present an end-to-end system that goes from video sequences to high resolution, editable, dynamically controllable face models. The capture system employs synchronized video cameras and structured light projectors to record videos of a moving face from multiple viewpoints. A novel spacetime stereo algorithm is introduced to compute depth maps accurately and overcome over-fitting deficiencies in prior work. A new template fitting and tracking procedure fills in missing data and yields point correspondence across the entire sequence without using markers. We demonstrate a data-driven, interactive method for inverse kinematics that draws on the large set of fitted templates and allows for posing new expressions by dragging surface points directly. Finally, we describe new tools that model the dynamics in the input sequence to enable new animations, created via key-framing or texture-synthesis techniques.