Recovering high dynamic range radiance maps from photographs
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
A morphable model for the synthesis of 3D faces
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
A Flexible New Technique for Camera Calibration
IEEE Transactions on Pattern Analysis and Machine Intelligence
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Shader Lamps: Animating Real Objects With Image-Based Illumination
Proceedings of the 12th Eurographics Workshop on Rendering Techniques
Multiple View Geometry in Computer Vision
Multiple View Geometry in Computer Vision
Linear rotation-invariant coordinates for meshes
ACM SIGGRAPH 2005 Papers
ACM SIGGRAPH 2005 Papers
Interactive humanoids and androids as ideal interfaces for humans
Proceedings of the 11th international conference on Intelligent user interfaces
Multifocal Projection: A Multiprojector Technique for Increasing Focal Depth
IEEE Transactions on Visualization and Computer Graphics
Image deformation using moving least squares
ACM SIGGRAPH 2006 Papers
Projection defocus analysis for scene capture and image display
ACM SIGGRAPH 2006 Papers
Analysis of human faces using a measurement-based skin reflectance model
ACM SIGGRAPH 2006 Papers
Practical Methods for Geometric and Photometric Correction of Tiled Projector
CVPRW '06 Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop
A Validated Method for Dense Non-rigid 3D Face Registration
AVSS '06 Proceedings of the IEEE International Conference on Video and Signal Based Surveillance
Poisson surface reconstruction
SGP '06 Proceedings of the fourth Eurographics symposium on Geometry processing
Radiometric Compensation through Inverse Light Transport
PG '07 Proceedings of the 15th Pacific Conference on Computer Graphics and Applications
Estimating multi-layer scattering in faces using direct-indirect separation
ACM SIGGRAPH 2008 talks
The visual computing of projector-camera systems
ACM SIGGRAPH 2008 classes
Defocus Blur Correcting Projector-Camera System
ACIVS '08 Proceedings of the 10th International Conference on Advanced Concepts for Intelligent Vision Systems
Animatronic Shader Lamps Avatars
ISMAR '09 Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality
Global correspondence optimization for non-rigid registration of depth scans
SGP '08 Proceedings of the Symposium on Geometry Processing
ACM SIGGRAPH 2010 papers
ACM Transactions on Graphics (TOG)
A quantized-diffusion model for rendering translucent materials
ACM SIGGRAPH 2011 papers
High-quality passive facial performance capture using anchor frames
ACM SIGGRAPH 2011 papers
Virtual Reality - Special Issue on Augmented Reality
Taming Mona Lisa: Communicating gaze faithfully in 2D and 3D facial projections
ACM Transactions on Interactive Intelligent Systems (TiiS)
Fast high-resolution appearance editing using superimposed projections
ACM Transactions on Graphics (TOG)
Spacetime expression cloning for blendshapes
ACM Transactions on Graphics (TOG)
AH '12 Proceedings of the 3rd Augmented Human International Conference
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Image quality assessment: from error visibility to structural similarity
IEEE Transactions on Image Processing
Practical Non-linear Photometric Projector Compensation
CVPRW '13 Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops
Hi-index | 0.00 |
Animated animatronic figures are a unique way to give physical presence to a character. However, their movement and expressions are often limited due to mechanical constraints. In this paper, we propose a complete process for augmenting physical avatars using projector-based illumination, significantly increasing their expressiveness. Given an input animation, the system decomposes the motion into low-frequency motion that can be physically reproduced by the animatronic head and high-frequency details that are added using projected shading. At the core is a spatio-temporal optimization process that compresses the motion in gradient space, ensuring faithful motion replay while respecting the physical limitations of the system. We also propose a complete multi-camera and projection system, including a novel defocused projection and subsurface scattering compensation scheme. The result of our system is a highly expressive physical avatar that features facial details and motion otherwise unattainable due to physical constraints.