Scanning physical interaction behavior of 3D objects
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Synthesizing sounds from physically based motion
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
A practical model for subsurface light transport
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Real Sound Synthesis for Interactive Applications
Real Sound Synthesis for Interactive Applications
Synthesizing sounds from rigid-body simulations
Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
Convergence Properties of the Nelder--Mead Simplex Method in Low Dimensions
SIAM Journal on Optimization
Content-based organization and visualization of music archives
Proceedings of the tenth ACM international conference on Multimedia
Real-time rendering of aerodynamic sound using sound textures based on computational fluid dynamics
ACM SIGGRAPH 2003 Papers
Interactive simulation of complex audiovisual scenes
Presence: Teleoperators and Virtual Environments - Special section: Advances in interactive multimodal telepresent systems
Microsound
Presence: Teleoperators and Virtual Environments
Timbrefields: 3d interactive sound models for real-time audio
Presence: Teleoperators and Virtual Environments
Fast modal sounds with scalable frequency-domain synthesis
ACM SIGGRAPH 2008 papers
ACM SIGGRAPH 2009 papers
Realistic real-time sound re-synthesis and processing for interactive virtual worlds
The Visual Computer: International Journal of Computer Graphics
Harmonic shells: a practical nonlinear sound model for near-rigid thin shells
ACM SIGGRAPH Asia 2009 papers
Rigid-body fracture sound with precomputed soundbanks
ACM SIGGRAPH 2010 papers
Sounding liquids: Automatic sound synthesis from fluid simulation
ACM Transactions on Graphics (TOG)
Sound synthesis for impact sounds in video games
I3D '11 Symposium on Interactive 3D Graphics and Games
Toward high-quality modal contact sound
ACM SIGGRAPH 2011 papers
ACM SIGGRAPH 2011 papers
Tabletop Ensemble: touch-enabled virtual percussion instruments
I3D '12 Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
Synthesizing contact sounds between textured models
VR '10 Proceedings of the 2010 IEEE Virtual Reality Conference
Modeling timbre distance with temporal statistics from polyphonic music
IEEE Transactions on Audio, Speech, and Language Processing
| Hi-index | 0.00 |
Linear modal synthesis methods have often been used to generate sounds for rigid bodies. One of the key challenges in widely adopting such techniques is the lack of automatic determination of satisfactory material parameters that recreate realistic audio quality of sounding materials. We introduce a novel method using prerecorded audio clips to estimate material parameters that capture the inherent quality of recorded sounding materials. Our method extracts perceptually salient features from audio examples. Based on psychoacoustic principles, we design a parameter estimation algorithm using an optimization framework and these salient features to guide the search of the best material parameters for modal synthesis. We also present a method that compensates for the differences between the real-world recording and sound synthesized using solely linear modal synthesis models to create the final synthesized audio. The resulting audio generated from this sound synthesis pipeline well preserves the same sense of material as a recorded audio example. Moreover, both the estimated material parameters and the residual compensation naturally transfer to virtual objects of different sizes and shapes, while the synthesized sounds vary accordingly. A perceptual study shows the results of this system compare well with real-world recordings in terms of material perception.