Reconstructing mass-conserved water surfaces using shape from shading and optical flow

Authors:
David Pickup;Chuan Li;Darren Cosker;Peter Hall;Phil Willis
Affiliations:
Media Technology Research Centre, University of Bath;Media Technology Research Centre, University of Bath;Media Technology Research Centre, University of Bath;Media Technology Research Centre, University of Bath;Media Technology Research Centre, University of Bath
Venue:
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV
Year:
2010

Citing 14
Cited 0

Surface Shape Reconstruction of a Nonrigid Transport Object Using Refraction and Motion

IEEE Transactions on Pattern Analysis and Machine Intelligence
Shape from Shading: A Survey

IEEE Transactions on Pattern Analysis and Machine Intelligence
Multichannel Shape from Shading Techniques for Moving Specular Surfaces

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
Reconstructing the Geometry of Flowing Water

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Dynamic Refraction Stereo

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Image-based tree modeling

ACM SIGGRAPH 2007 papers
Hair photobooth: geometric and photometric acquisition of real hairstyles

ACM SIGGRAPH 2008 papers
Performance capture from sparse multi-view video

ACM SIGGRAPH 2008 papers
Single image tree modeling

ACM SIGGRAPH Asia 2008 papers
Time-resolved 3d capture of non-stationary gas flows

ACM SIGGRAPH Asia 2008 papers
Practical modeling and acquisition of layered facial reflectance

ACM SIGGRAPH Asia 2008 papers
Physically guided liquid surface modeling from videos

ACM SIGGRAPH 2009 papers
Image assimilation for motion estimation of atmospheric layers with shallow-water model

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I
DynTex: A comprehensive database of dynamic textures

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper introduces a method for reconstructing water from real video footage. Using a single input video, the proposed method produces a more informative reconstruction from a wider range of possible scenes than the current state of the art. The key is the combination of vision algorithms and physics laws. Shape from shading is used to capture the change of the water's surface, from which a vertical velocity gradient field is calculated. Such a gradient field is used to constrain the tracking of horizontal velocities by minimizing an energy function as a weighted combination of mass-conservation and intensity-conservation. Hence the final reconstruction contains a dense velocity field that is incompressible in 3D. The proposed method is efficient and performs consistently well across water of different types.