Recovering high dynamic range radiance maps from photographs
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
LCIS: a boundary hierarchy for detail-preserving contrast reduction
Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Image Editing in the Contour Domain
IEEE Transactions on Pattern Analysis and Machine Intelligence
Video matting of complex scenes
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Gradient domain high dynamic range compression
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Fast bilateral filtering for the display of high-dynamic-range images
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Photographic tone reproduction for digital images
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
SIGGRAPH '84 Proceedings of the 11th annual conference on Computer graphics and interactive techniques
Graphcut textures: image and video synthesis using graph cuts
ACM SIGGRAPH 2003 Papers
ACM SIGGRAPH 2003 Papers
Sparse matrix solvers on the GPU: conjugate gradients and multigrid
ACM SIGGRAPH 2003 Papers
Proscenium: a framework for spatio-temporal video editing
MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
Image fusion for context enhancement and video surrealism
Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering
ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3 - Volume 03
Sparse lumigraph relighting by illumination and reflectance estimation from multi-view images
EGSR'06 Proceedings of the 17th Eurographics conference on Rendering Techniques
Face swapping: automatically replacing faces in photographs
ACM SIGGRAPH 2008 papers
MovieReshape: tracking and reshaping of humans in videos
ACM SIGGRAPH Asia 2010 papers
Hi-index | 0.00 |
This paper proposes a new framework for video editing in gradient domain. The spatio-temporal gradient fields of target videos are modified and/or mixed to generate a new gradient field which is usually not integrable. We compare two methods to solve this ''mixed gradient problem'', i.e., the variational method and loopy belief propagation. We propose a 3D video integration algorithm, which uses the variational method to find the potential function whose gradient field is closest to the mixed gradient field in the sense of least squares. The video is reconstructed by solving a 3D Poisson equation. The main contributions of our framework lie in three aspects: first, we derive a straightforward extension of current 2D gradient technique to 3D space, thus resulting in a novel video editing framework, which is very different from all current video editing software; secondly, we propose using a fast and accurate 3D discrete Poisson solver which uses diagonal multigrids to solve the 3D Poisson equation, which is up to twice as fast as a simple conventional multigrid algorithm; finally, we introduce a set of new applications, such as face replacement and painting, high dynamic range video compression and graphcut based video compositing. A set of gradient operators is also provided to the user for editing purposes. We evaluate our algorithm using a variety of examples for image/video or video/video pairs. The resulting video can be seamlessly reconstructed.