Design patterns: elements of reusable object-oriented software
Design patterns: elements of reusable object-oriented software
A beam tracing approach to acoustic modeling for interactive virtual environments
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
SCG '85 Proceedings of the first annual symposium on Computational geometry
Creating Interactive Virtual Auditory Environments
IEEE Computer Graphics and Applications
Beam tracing polygonal objects
SIGGRAPH '84 Proceedings of the 11th annual conference on Computer graphics and interactive techniques
Significant facet retrieval for real-time 3D sound rendering in complex virtual environments
Proceedings of the ACM symposium on Virtual reality software and technology
Perceptual audio rendering of complex virtual environments
ACM SIGGRAPH 2004 Papers
| Hi-index | 0.00 |
Recent studies have shown that the combination of auditory and visual cues enhances the sense of immersion in virtual reality or interactive entertainment applications. However, realtime 3D audiovisual rendering requires high computational cost. In this paper, to reduce realtime computation, we suggest a novel framework of optimized 3D sound rendering, where we define Audio Scenegraph that contains reduced 3D scene information and the necessary parameters for computing early reflections of sound. During pre-computation phase using our framework, graphic reduction and sound source reduction are accomplished according to the environment containing complex 3D scene, sound sources, and a listener. That is, complex 3D scene is reduced to a set of significant facets for sound rendering, and the resulting scene is represented as Audio Scenegraph we defined. And then, the graph is transmitted to the sound engine which clusters a number of sound sources for reducing realtime calculation of sound propagation. For sound source reduction, it is required to estimate early reflection time to test perceptual culling and to cluster sounds which are reachable to facets of each sub space according to the estimation results. During realtime phase according to the position, direction and index of the space of a listener, sounds inside sub space are played by image method and sounds outside sub space are also played by assigning clustered sounds to buffers. Even if the number of sounds is increased, realtime calculation is very stable because most calculations about sounds can be performed offline. It took very consistent time for 3D sound rendering regardless of complexity of 3D scene including hundreds of sound sources by this method. As a future study, it is required to estimate the perceptual acceptance of grouping algorithm by user test.