SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
Fundamentals of speech recognition
Fundamentals of speech recognition
Versatile and efficient techniques for simulating cloth and other deformable objects
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Pyramid-based texture analysis/synthesis
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Large steps in cloth simulation
Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Synthesizing sounds from physically based motion
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
A practical model for subsurface light transport
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Real Sound Synthesis for Interactive Applications
Real Sound Synthesis for Interactive Applications
Synthesizing sounds from rigid-body simulations
Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
Motion capture assisted animation: texturing and synthesis
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Robust treatment of collisions, contact and friction for cloth animation
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Synthesizing Sound Textures through Wavelet Tree Learning
IEEE Computer Graphics and Applications
Shape Matching and Object Recognition Using Shape Contexts
IEEE Transactions on Pattern Analysis and Machine Intelligence
Feel the "fabric": an audio-haptic interface
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Sound-by-numbers: motion-driven sound synthesis
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Texture design using a simplicial complex of morphable textures
ACM SIGGRAPH 2005 Papers
Interactive sound synthesis for large scale environments
I3D '06 Proceedings of the 2006 symposium on Interactive 3D graphics and games
Microsound
Unit selection in a concatenative speech synthesis system using a large speech database
ICASSP '96 Proceedings of the Acoustics, Speech, and Signal Processing, 1996. on Conference Proceedings., 1996 IEEE International Conference - Volume 01
Simulating knitted cloth at the yarn level
ACM SIGGRAPH 2008 papers
Harmonic shells: a practical nonlinear sound model for near-rigid thin shells
ACM SIGGRAPH Asia 2009 papers
Rigid-body fracture sound with precomputed soundbanks
ACM SIGGRAPH 2010 papers
Time-frequency synthesis of noisy sounds with narrow spectral components
IEEE Transactions on Audio, Speech, and Language Processing
ACM SIGGRAPH 2011 papers
Synthesis of Hand Clapping Sounds
IEEE Transactions on Audio, Speech, and Language Processing
| Hi-index | 0.00 |
We present a practical data-driven method for automatically synthesizing plausible soundtracks for physics-based cloth animations running at graphics rates. Given a cloth animation, we analyze the deformations and use motion events to drive crumpling and friction sound models estimated from cloth measurements. We synthesize a low-quality sound signal, which is then used as a target signal for a concatenative sound synthesis (CSS) process. CSS selects a sequence of microsound units, very short segments, from a database of recorded cloth sounds, which best match the synthesized target sound in a low-dimensional feature-space after applying a hand-tuned warping function. The selected microsound units are concatenated together to produce the final cloth sound with minimal filtering. Our approach avoids expensive physics-based synthesis of cloth sound, instead relying on cloth recordings and our motion-driven CSS approach for realism. We demonstrate its effectiveness on a variety of cloth animations involving various materials and character motions, including first-person virtual clothing with binaural sound.