Feature-based image metamorphosis
SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
View interpolation for image synthesis
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Plenoptic modeling: an image-based rendering system
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Proceedings of the 1997 symposium on Interactive 3D graphics
Spatio-temporal view interpolation
EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
Image-Based Rendering Using Image-Based Priors
International Journal of Computer Vision
Accelerating real-time shading with reverse reprojection caching
Proceedings of the 22nd ACM SIGGRAPH/EUROGRAPHICS symposium on Graphics hardware
Perception-motivated interpolation of image sequences
Proceedings of the 5th symposium on Applied perception in graphics and visualization
Automated reprojection-based pixel shader optimization
ACM SIGGRAPH Asia 2008 papers
An improved shading cache for modern GPUs
Proceedings of the 23rd ACM SIGGRAPH/EUROGRAPHICS symposium on Graphics hardware
Moving gradients: a path-based method for plausible image interpolation
ACM SIGGRAPH 2009 papers
ACM SIGGRAPH Asia 2009 papers
Real-Time Soft Shadows Using Temporal Coherence
ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part II
Spatio-temporal upsampling on the GPU
Proceedings of the 2010 ACM SIGGRAPH symposium on Interactive 3D Graphics and Games
Real-time frame rate up-conversion for video games: or how to get from 30 to 60 fps for "free"
ACM SIGGRAPH 2010 Talks
Image quality assessment: from error visibility to structural similarity
IEEE Transactions on Image Processing
Overview of the H.264/AVC video coding standard
IEEE Transactions on Circuits and Systems for Video Technology
Pixel-correct shadow maps with temporal reprojection and shadow test confidence
EGSR'07 Proceedings of the 18th Eurographics conference on Rendering Techniques
Temporal Coherence Methods in Real-Time Rendering
Computer Graphics Forum
| Hi-index | 0.00 |
We introduce a method for increasing the framerate of real-time rendering applications. Whereas many existing temporal upsampling strategies only reuse information from previous frames, our bidirectional technique reconstructs intermediate frames from a pair of consecutive rendered frames. This significantly improves the accuracy and efficiency of data reuse since very few pixels are simultaneously occluded in both frames. We present two versions of this basic algorithm. The first is appropriate for fill-bound scenes as it limits the number of expensive shading calculations, but involves rasterization of scene geometry at each intermediate frame. The second version, our more significant contribution, reduces both shading and geometry computations by performing reprojection using only image-based buffers. It warps and combines the adjacent rendered frames using an efficient iterative search on their stored scene depth and flow. Bidirectional reprojection introduces a small amount of lag. We perform a user study to investigate this lag, and find that its effect is minor. We demonstrate substantial performance improvements (3--4x) for a variety of applications, including vertex-bound and fill-bound scenes, multi-pass effects, and motion blur.