Lightweight binocular facial performance capture under uncontrolled lighting
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Template-Based conformal shape-from-motion-and-shading for laparoscopy
IPCAI'12 Proceedings of the Third international conference on Information Processing in Computer-Assisted Interventions
Non-rigid 3D shape tracking from multiview video
Computer Vision and Image Understanding
Improved reconstruction of deforming surfaces by cancelling ambient occlusion
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part I
Full body performance capture under uncontrolled and varying illumination: a shading-based approach
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Free-viewpoint video rendering for mobile devices
Proceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications
Sparse localized deformation components
ACM Transactions on Graphics (TOG)
On-set performance capture of multiple actors with a stereo camera
ACM Transactions on Graphics (TOG)
| Hi-index | 0.00 |
We present an approach to add true fine-scale spatio-temporal shape detail to dynamic scene geometry captured from multi-view video footage. Our approach exploits shading information to recover the millimeter-scale surface structure, but in contrast to related approaches succeeds under general unconstrained lighting conditions. Our method starts off from a set of multi-view video frames and an initial series of reconstructed coarse 3D meshes that lack any surface detail. In a spatio-temporal maximum a posteriori probability (MAP) inference framework, our approach first estimates the incident illumination and the spatially-varying albedo map on the mesh surface for every time instant. Thereafter, albedo and illumination are used to estimate the true geometric detail visible in the images and add it to the coarse reconstructions. The MAP framework uses weak temporal priors on lighting, albedo and geometry which improve reconstruction quality yet allow for temporal variations in the data.