Numerical recipes in C (2nd ed.): the art of scientific computing
Numerical recipes in C (2nd ed.): the art of scientific computing
Discrete-time signal processing (2nd ed.)
Discrete-time signal processing (2nd ed.)
Scanning physical interaction behavior of 3D objects
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
A practical model for subsurface light transport
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Synthesizing sounds from rigid-body simulations
Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
Interactive simulation of complex audiovisual scenes
Presence: Teleoperators and Virtual Environments - Special section: Advances in interactive multimodal telepresent systems
Perceptual audio rendering of complex virtual environments
ACM SIGGRAPH 2004 Papers
Interactive sound synthesis for large scale environments
I3D '06 Proceedings of the 2006 symposium on Interactive 3D graphics and games
Progressive perceptual audio rendering of complex scenes
Proceedings of the 2007 symposium on Interactive 3D graphics and games
Presence: Teleoperators and Virtual Environments
Audiovisual 3d rendering as a tool for multimodal interfaces
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Efficient and practical audio-visual rendering for games using crossmodal perception
Proceedings of the 2009 symposium on Interactive 3D graphics and games
ACM SIGGRAPH 2009 papers
Harmonic shells: a practical nonlinear sound model for near-rigid thin shells
ACM SIGGRAPH Asia 2009 papers
Bimodal perception of audio-visual material properties for virtual environments
ACM Transactions on Applied Perception (TAP)
Rigid-body fracture sound with precomputed soundbanks
ACM SIGGRAPH 2010 papers
Sounding liquids: Automatic sound synthesis from fluid simulation
ACM Transactions on Graphics (TOG)
A 3-D immersive synthesizer for environmental sounds
IEEE Transactions on Audio, Speech, and Language Processing
Sound synthesis for impact sounds in video games
I3D '11 Symposium on Interactive 3D Graphics and Games
Advances in modal analysis using a robust and multiscale method
EURASIP Journal on Advances in Signal Processing - Special issue on digital audio effects
Toward high-quality modal contact sound
ACM SIGGRAPH 2011 papers
Spatial audio: graphic modeling for X3D
Proceedings of the 16th International Conference on 3D Web Technology
Synthesizing physics-based vortex and collision sound in virtual reality
ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part II
Interactive sound propagation using compact acoustic transfer operators
ACM Transactions on Graphics (TOG)
Tabletop Ensemble: touch-enabled virtual percussion instruments
I3D '12 Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
Precomputed acceleration noise for improved rigid-body sound
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Acoustic Rendering and Auditory–Visual Cross-Modal Perception and Interaction
Computer Graphics Forum
Example-guided physically based modal sound synthesis
ACM Transactions on Graphics (TOG)
Faster acceleration noise for multibody animations using precomputed soundbanks
EUROSCA'12 Proceedings of the 11th ACM SIGGRAPH / Eurographics conference on Computer Animation
Faster acceleration noise for multibody animations using precomputed soundbanks
Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation
3D Virtual worlds and the metaverse: Current status and future possibilities
ACM Computing Surveys (CSUR)
Sound localization and multi-modal steering for autonomous virtual agents
Proceedings of the 18th meeting of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
| Hi-index | 0.00 |
Audio rendering of impact sounds, such as those caused by falling objects or explosion debris, adds realism to interactive 3D audiovisual applications, and can be convincingly achieved using modal sound synthesis. Unfortunately, mode-based computations can become prohibitively expensive when many objects, each with many modes, are impacted simultaneously. We introduce a fast sound synthesis approach, based on short-time Fourier Tranforms, that exploits the inherent sparsity of modal sounds in the frequency domain. For our test scenes, this "fast mode summation" can give speedups of 5--8 times compared to a time-domain solution, with slight degradation in quality. We discuss different reconstruction windows, affecting the quality of impact sound "attacks". Our Fourier-domain processing method allows us to introduce a scalable, real-time, audio processing pipeline for both recorded and modal sounds, with auditory masking and sound source clustering. To avoid abrupt computation peaks, such as during the simultaneous impacts of an explosion, we use crossmodal perception results on audiovisual synchrony to effect temporal scheduling. We also conducted a pilot perceptual user evaluation of our method. Our implementation results show that we can treat complex audiovisual scenes in real time with high quality.