The missing link: modal synthesis
Representations of musical signals
Issues and techniques in touch-sensitive tablet input
SIGGRAPH '85 Proceedings of the 12th annual conference on Computer graphics and interactive techniques
Real Sound Synthesis for Interactive Applications
Real Sound Synthesis for Interactive Applications
Synthesizing sounds from rigid-body simulations
Proceedings of the 2002 ACM SIGGRAPH/Eurographics symposium on Computer animation
Low-cost multi-touch sensing through frustrated total internal reflection
Proceedings of the 18th annual ACM symposium on User interface software and technology
Interactive sound synthesis for large scale environments
I3D '06 Proceedings of the 2006 symposium on Interactive 3D graphics and games
Synthesis and control on large scale multi-touch sensing displays
NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Modal Synthesis for Arbitrarily Shaped Objects
Computer Music Journal
New Digital Musical Instruments: Control And Interaction Beyond the Keyboard (Computer Music and Digital Audio Series)
Proceedings of the ACM/IEEE international conference on Human-robot interaction
Presence: Teleoperators and Virtual Environments
Physical models and musical controllers: designing a novel electronic percussion instrument
NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
Fast modal sounds with scalable frequency-domain synthesis
ACM SIGGRAPH 2008 papers
AD-Frustum: Adaptive Frustum Tracing for Interactive Sound Propagation
IEEE Transactions on Visualization and Computer Graphics
The UnMousePad: an interpolating multi-touch force-sensing input pad
ACM SIGGRAPH 2009 papers
Efficient and Accurate Sound Propagation Using Adaptive Rectangular Decomposition
IEEE Transactions on Visualization and Computer Graphics
Precomputed wave simulation for real-time sound propagation of dynamic sources in complex scenes
ACM SIGGRAPH 2010 papers
EUROVIS'06 Proceedings of the Eighth Joint Eurographics / IEEE VGTC conference on Visualization
Example-guided physically based modal sound synthesis
ACM Transactions on Graphics (TOG)
Dynamics based 3D skeletal hand tracking
Proceedings of Graphics Interface 2013
| Hi-index | 0.00 |
We present an interactive virtual percussion instrument system, Tabletop Ensemble, that can be used by a group of collaborative users simultaneously to emulate playing music in real world while providing them with flexibility of virtual simulations. An optical multi-touch tabletop serves as the input device. A novel touch handling algorithm for such devices is presented to translate users' interactions into percussive control signals appropriate for music playing. These signals activate the proposed sound simulation system for generating realistic user-controlled musical sounds. A fast physically-based sound synthesis technique, modal synthesis, is adopted to enable users to directly produce rich, varying musical tones, as they would with the real percussion instruments. In addition, we propose a simple coupling scheme for modulating the synthesized sounds by an accurate numerical acoustic simulator to create believable acoustic effects due to cavity in music instruments. This paradigm allows creating new virtual percussion instruments of various materials, shapes, and sizes with little overhead. We believe such an interactive, multi-modal system would offer capabilities for expressive music playing, rapid prototyping of virtual instruments, and active exploration of sound effects determined by various physical parameters in a classroom, museum, or other educational settings. Virtual xylophones and drums with various physics properties are shown in the presented system.