View interpolation for image synthesis
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Performance of optical flow techniques
International Journal of Computer Vision
Plenoptic modeling: an image-based rendering system
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
The robust estimation of multiple motions: parametric and piecewise-smooth flow fields
Computer Vision and Image Understanding
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Fast Approximate Energy Minimization via Graph Cuts
IEEE Transactions on Pattern Analysis and Machine Intelligence
Digital Image Warping
Hierarchical Estimation and Segmentation of Dense Motion Fields
International Journal of Computer Vision
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
International Journal of Computer Vision
Occlusions and Binocular Stereo
ECCV '92 Proceedings of the Second European Conference on Computer Vision
Graphcut textures: image and video synthesis using graph cuts
ACM SIGGRAPH 2003 Papers
ACM SIGGRAPH 2003 Papers
Image-based rendering using image-based priors
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Interactive digital photomontage
ACM SIGGRAPH 2004 Papers
ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 3 - Volume 03
Symmetric Stereo Matching for Occlusion Handling
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Videoshop: A New Framework for Spatio-Temporal Video Editing in Gradient Domain
CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Digital Image Processing (3rd Edition)
Digital Image Processing (3rd Edition)
Consistent Segmentation for Optical Flow Estimation
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
ACM SIGGRAPH 2006 Papers
Symmetrical Dense Optical Flow Estimation with Occlusions Detection
International Journal of Computer Vision
Image Stitching Using Structure Deformation
IEEE Transactions on Pattern Analysis and Machine Intelligence
Bilateral filtering-based optical flow estimation with occlusion detection
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
A nonparametric regression model for virtual humans generation
Multimedia Tools and Applications
Nonlinear disparity mapping for stereoscopic 3D
ACM SIGGRAPH 2010 papers
Multi-image interpolation based on graph-cuts and symmetric optical flow
ACM SIGGRAPH 2010 Posters
Space-time visual effects as a post-production process
Proceedings of the 1st international workshop on 3D video processing
A Database and Evaluation Methodology for Optical Flow
International Journal of Computer Vision
Video temporal super-resolution based on self-similarity
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part I
Image-based bidirectional scene reprojection
Proceedings of the 2011 SIGGRAPH Asia Conference
Optical flow guided TV-L1 video interpolation and restoration
EMMCVPR'11 Proceedings of the 8th international conference on Energy minimization methods in computer vision and pattern recognition
Tennis real play: an interactive tennis game with models from real videos
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Multidimensional image retargeting
SIGGRAPH Asia 2011 Courses
Towards plenoptic raumzeit reconstruction
Proceedings of the 2010 international conference on Video Processing and Computational Video
Two algorithms for motion estimation from alternate exposure images
Proceedings of the 2010 international conference on Video Processing and Computational Video
Tools for placing cuts and transitions in interview video
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Face morphing using 3D-aware appearance optimization
Proceedings of Graphics Interface 2012
Multimedia Tools and Applications
Silhouette-aware warping for image-based rendering
EGSR'11 Proceedings of the Twenty-second Eurographics conference on Rendering
Perception of visual artifacts in image-based rendering of façades
EGSR'11 Proceedings of the Twenty-second Eurographics conference on Rendering
Automated video looping with progressive dynamism
ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Depth synthesis and local warps for plausible image-based navigation
ACM Transactions on Graphics (TOG)
Image-based rendering in the gradient domain
ACM Transactions on Graphics (TOG)
Stereo/multiview picture quality: Overview and recent advances
Image Communication
Hi-index | 0.00 |
We describe a method for plausible interpolation of images, with a wide range of applications like temporal up-sampling for smooth playback of lower frame rate video, smooth view interpolation, and animation of still images. The method is based on the intuitive idea, that a given pixel in the interpolated frames traces out a path in the source images. Therefore, we simply move and copy pixel gradients from the input images along this path. A key innovation is to allow arbitrary (asymmetric) transition points, where the path moves from one image to the other. This flexible transition preserves the frequency content of the originals without ghosting or blurring, and maintains temporal coherence. Perhaps most importantly, our framework makes occlusion handling particularly simple. The transition points allow for matches away from the occluded regions, at any suitable point along the path. Indeed, occlusions do not need to be handled explicitly at all in our initial graph-cut optimization. Moreover, a simple comparison of computed path lengths after the optimization, allows us to robustly identify occluded regions, and compute the most plausible interpolation in those areas. Finally, we show that significant improvements are obtained by moving gradients and using Poisson reconstruction.