IEEE Transactions on Pattern Analysis and Machine Intelligence
Active blobs: region-based, deformable appearance models
Computer Vision and Image Understanding - Special issue on nonrigid image registration
Efficient, Robust and Accurate Fitting of a 3D Morphable Model
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Lucas-Kanade 20 Years On: A Unifying Framework
International Journal of Computer Vision
Augmenting Deformable Objects in Real-Time
ISMAR '05 Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality
A Mean Field EM-algorithm for Coherent Occlusion Handling in MAP-Estimation Prob
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Combining Cues: Shape from Shading and Texture
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Surface Deformation Models for Nonrigid 3D Shape Recovery
IEEE Transactions on Pattern Analysis and Machine Intelligence
Fast Non-Rigid Surface Detection, Registration and Realistic Augmentation
International Journal of Computer Vision
Active appearance models with occlusion
Image and Vision Computing
Retexturing single views using texture and shading
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part IV
Tracking dynamic near-regular texture under occlusion and rapid movements
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II
Technical Section: Realistic cloth augmentation in single view video under occlusions
Computers and Graphics
Efficient image/video retexturing using parallel bilateral grids
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
VEA 2012: Interactive image/video retexturing using GPU parallelism
Computers and Graphics
| Hi-index | 0.00 |
We present a non-rigid registration technique that achieves spatial, photometric, and visibility accuracy. It lets us photo-realistically augment 3D deformable surfaces under complex illumination conditions and in spite of severe occlusions. There are many approaches that address some of these issues but very few that simultaneously handle all of them as we do. We use triangulated meshes to model the geometry and introduce explicit visibility maps as well as separate illumination parameters for each mesh vertex. We cast our registration problem in an Expectation Maximization framework that allows robust and fully automated operation. It provides explicit illumination and occlusion models that can be used for rendering purposes.