Perceptually-driven decision theory for interactive realistic rendering

Authors:
Reynald Dumont;Fabio Pellacini;James A. Ferwerda
Affiliations:
Cornell University, Ithaca, NY;Cornell University, Ithaca, NY;Cornell University, Ithaca, NY
Venue:
ACM Transactions on Graphics (TOG)
Year:
2003

Citing 48
Cited 21

A rapid hierarchical radiosity algorithm

Proceedings of the 18th annual conference on Computer graphics and interactive techniques
Adaptive display algorithm for interactive frame rates during visualization of complex virtual environments

SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Visibility computations in densely occluded polyhedral environments

Visibility computations in densely occluded polyhedral environments
The visible differences predictor: an algorithm for the assessment of image fidelity

Digital images and human vision
Visual navigation of large environments using textured clusters

I3D '95 Proceedings of the 1995 symposium on Interactive 3D graphics
Portals and mirrors: simple, fast evaluation of potentially visible sets

I3D '95 Proceedings of the 1995 symposium on Interactive 3D graphics
QuickTime VR: an image-based approach to virtual environment navigation

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Hierarchical image caching for accelerated walkthroughs of complex environments

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Progressive meshes

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Talisman: commodity realtime 3D graphics for the PC

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Rendering from compressed textures

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Multi-pass pipeline rendering: realism for dynamic environments

Proceedings of the 1997 symposium on Interactive 3D graphics
Fitting virtual lights for non-diffuse walkthroughs

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
A model of visual masking for computer graphics

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Rendering with coherent layers

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
A perceptually based adaptive sampling algorithm

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Prefetching in a texture cache architecture

HWWS '98 Proceedings of the ACM SIGGRAPH/EUROGRAPHICS workshop on Graphics hardware
Interactive display of very large textures

Proceedings of the conference on Visualization '98
Interactive ray tracing

I3D '99 Proceedings of the 1999 symposium on Interactive 3D graphics
Increased photorealism for interactive architectural walkthroughs

I3D '99 Proceedings of the 1999 symposium on Interactive 3D graphics
MMR: an interactive massive model rendering system using geometric and image-based acceleration

I3D '99 Proceedings of the 1999 symposium on Interactive 3D graphics
A perceptually based physical error metric for realistic image synthesis

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Reflection space image based rendering

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Realistic, hardware-accelerated shading and lighting

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Real-time rendering

Real-time rendering
Approximate Algorithms for the 0/1 Knapsack Problem

Journal of the ACM (JACM)
The holodeck ray cache: an interactive rendering system for global illumination in nondiffuse environments

ACM Transactions on Graphics (TOG)
Toward a psychophysically-based light reflection model for image synthesis

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Conservative volumetric visibility with occluder fusion

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Conservative visibility preprocessing using extended projections

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Measuring and predicting visual fidelity

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Perception-guided global illumination solution for animation rendering

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments

ACM Transactions on Graphics (TOG)
Interactive global illumination in dynamic scenes

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Computers and Intractability: A Guide to the Theory of NP-Completeness

Computers and Intractability: A Guide to the Theory of NP-Completeness
A Real-Time Photo-Realistic Visual Flythrough

IEEE Transactions on Visualization and Computer Graphics
Perceiving Spatial Relationships in Computer-Generated Images

IEEE Computer Graphics and Applications
Interactive Rendering of Globally Illuminated Glossy Scenes

Proceedings of the Eurographics Workshop on Rendering Techniques '97
Unified Approach to Prefiltered Environment Maps

Proceedings of the Eurographics Workshop on Rendering Techniques 2000
Walkthroughs with Corrective Texturing

Proceedings of the Eurographics Workshop on Rendering Techniques 2000
Perceptually-Driven Simplification for Interactive Rendering

Proceedings of the 12th Eurographics Workshop on Rendering Techniques
Interactive Distributed Ray Tracing of Highly Complex Models

Proceedings of the 12th Eurographics Workshop on Rendering Techniques
A Perceptually-Based Texture Caching Algorithm for Hardware-Based Rendering

Proceedings of the 12th Eurographics Workshop on Rendering Techniques
Increasing update rates in the building walkthrough system with automatic model-space subdivision and potentially visible set calculations

Increasing update rates in the building walkthrough system with automatic model-space subdivision and potentially visible set calculations
Perception, attention, and resources: a decision-theoretic approach to graphics rendering

UAI'97 Proceedings of the Thirteenth conference on Uncertainty in artificial intelligence
Perceptually-informed accelerated rendering of high quality walkthrough sequences

EGWR'99 Proceedings of the 10th Eurographics conference on Rendering
Interactive rendering using the render cache

EGWR'99 Proceedings of the 10th Eurographics conference on Rendering
Towards interactive photorealistic rendering of indoor scenes: a hybrid approach

EGWR'99 Proceedings of the 10th Eurographics conference on Rendering

Perceptual illumination components: a new approach to efficient, high quality global illumination rendering

ACM SIGGRAPH 2004 Papers
On the Role of Color in the Perception of Motion in Animated Visualizations

VIS '04 Proceedings of the conference on Visualization '04
A perceptual framework for contrast processing of high dynamic range images

APGV '05 Proceedings of the 2nd symposium on Applied perception in graphics and visualization
Visual attention for efficient high-fidelity graphics

Proceedings of the 21st spring conference on Computer graphics
Selective component-based rendering

GRAPHITE '05 Proceedings of the 3rd international conference on Computer graphics and interactive techniques in Australasia and South East Asia
Perceptually driven interactive geometry remeshing

I3D '06 Proceedings of the 2006 symposium on Interactive 3D graphics and games
Efficient selective rendering of participating media

APGV '06 Proceedings of the 3rd symposium on Applied perception in graphics and visualization
A perceptual framework for contrast processing of high dynamic range images

ACM Transactions on Applied Perception (TAP)
Human visual perception of region warping distortions with different display and scene characteristics

Proceedings of the 4th international conference on Computer graphics and interactive techniques in Australasia and Southeast Asia
Visual attention in 3D video games

Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology
Exploiting perception in high-fidelity virtual environmentsAdditional presentations from the 24th course are available on the citation page

ACM SIGGRAPH 2006 Courses
A perceptual approach to trimming unstructured lumigraphs

Proceedings of the 4th symposium on Applied perception in graphics and visualization
Perceptual rendering of participating media

ACM Transactions on Applied Perception (TAP)
Just-noticeable difference estimation with pixels in images

Journal of Visual Communication and Image Representation
A perceptual approach to trimming and tuning unstructured lumigraphs

ACM Transactions on Applied Perception (TAP)
A local roughness measure for 3D meshes and its application to visual masking

ACM Transactions on Applied Perception (TAP)
Toward a perceptual space for gloss

ACM Transactions on Graphics (TOG)
An interactive perceptual rendering pipeline using contrast and spatial masking

EGSR'07 Proceedings of the 18th Eurographics conference on Rendering Techniques
Educative visuals - digital delivery of architectural information for (potential) heritage buildings

VAST'06 Proceedings of the 7th International conference on Virtual Reality, Archaeology and Intelligent Cultural Heritage
Time-constrained high-fidelity rendering on local desktop grids

EG PGV'09 Proceedings of the 9th Eurographics conference on Parallel Graphics and Visualization
Perceptual importance of lighting phenomena in rendering of animated water

ACM Transactions on Applied Perception (TAP)

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we introduce a new approach to realistic rendering at interactive rates on commodity graphics hardware. The approach uses efficient perceptual metrics within a decision theoretic framework to optimally order rendering operations, producing images of the highest visual quality within system constraints. We demonstrate the usefulness of this approach for various applications such as diffuse texture caching, environment map prioritization and radiosity mesh simplification. Although here we address the problem of realistic rendering at interactive rates, the perceptually-based decision theoretic methodology we introduce can be usefully applied in many areas of computer graphics.