Expressive expression mapping with ratio images
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Interactive Common Illumination for Computer Augmented Reality
Proceedings of the Eurographics Workshop on Rendering Techniques '97
Interactive Rendering with Real-World Illumination
Proceedings of the Eurographics Workshop on Rendering Techniques 2000
Real-Time Non-Rigid Surface Detection
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Randomized Trees for Real-Time Keypoint Recognition
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Retexturing in the Presence of Complex Illumination and Occlusions
ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
Texture replacement of garments in monocular video sequences
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
AUIC '12 Proceedings of the Thirteenth Australasian User Interface Conference - Volume 126
| Hi-index | 0.00 |
We present a real-time system that can draw virtual patterns or images on deforming real objects by estimating both the deformations and the shading parameters. We show that this is what is required to render the virtual elements so that they blend convincingly with the surrounding real textures. The whole process of uncompressing the video stream, measuring the deformations, estimating the lighting parameters, and realistically augmenting the input image takes about 100 ms on a 2.8 GHz PC. It is fully automated and does not require any manual initialization or engineering of the scene. It is also robust to large deformations, lighting changes, motion blur, specularities, and occlusions. It can therefore be demonstrated live on a simple laptop.