Height and gradient from shading
International Journal of Computer Vision
Image metamorphosis using snakes and free-form deformations
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
The robust estimation of multiple motions: parametric and piecewise-smooth flow fields
Computer Vision and Image Understanding
IEEE Transactions on Pattern Analysis and Machine Intelligence
Optical Flow Constraints on Deformable Models with Applications to Face Tracking
International Journal of Computer Vision
Image quilting for texture synthesis and transfer
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Texture synthesis over arbitrary manifold surfaces
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Video matting of complex scenes
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Adjusting Shape Parameters Using Model-Based Optical Flow Residuals
IEEE Transactions on Pattern Analysis and Machine Intelligence
Graphcut textures: image and video synthesis using graph cuts
ACM SIGGRAPH 2003 Papers
Visual Modeling with a Hand-Held Camera
International Journal of Computer Vision
ACM SIGGRAPH 2004 Papers
Textureshop: texture synthesis as a photograph editing tool
ACM SIGGRAPH 2004 Papers
Near-regular texture analysis and manipulation
ACM SIGGRAPH 2004 Papers
Spacetime faces: high resolution capture for modeling and animation
ACM SIGGRAPH 2004 Papers
ACM SIGGRAPH 2005 Papers
Video watercolorization using bidirectional texture advection
ACM SIGGRAPH 2007 papers
Depicting procedural caustics in single images
ACM SIGGRAPH Asia 2008 papers
Efficient image/video retexturing using parallel bilateral grids
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
VEA 2012: Interactive image/video retexturing using GPU parallelism
Computers and Graphics
| Hi-index | 0.00 |
We propose a video editing system that allows a user to apply a time-coherent texture to a surface depicted in the raw video from a single uncalibrated camera, including the surface texture mapping of a texture image and the surface texture synthesis from a texture swatch. Our system avoids the construction of a 3D shape model and instead uses the recovered normal field to deform the texture so that it plausibly adheres to the undulations of the depicted surface. The texture mapping method uses the nonlinear least-squares optimization of a spring model to control the behavior of the texture image as it is deformed to match the evolving normal field through the video. The texture synthesis method uses a coarse optical flow to advect clusters of pixels corresponding to patches of similarly oriented surface points. These clusters are organized into a minimum advection tree to account for the dynamic visibility of clusters. We take a rather crude approach to normal recovering and optical flow estimation, yet the results are robust and plausible for nearly diffuse surfaces such as faces and t-shirts.