Elements of computer music
Synthetic actors in computer-generated 3D films
Synthetic actors in computer-generated 3D films
Advanced animation and rendering techniques
Advanced animation and rendering techniques
Fugue: A Functional Language for Sound Synthesis
Computer - Special issue: Computer-generated music
Artificial evolution for computer graphics
Proceedings of the 18th annual conference on Computer graphics and interactive techniques
Localization in virtual acoustic displays
Presence: Teleoperators and Virtual Environments - Premier issue
SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
INTERCHI '93 Proceedings of the INTERCHI '93 conference on Human factors in computing systems
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
SIGGRAPH '85 Proceedings of the 12th annual conference on Computer graphics and interactive techniques
Realistic animation of rigid bodies
SIGGRAPH '88 Proceedings of the 15th annual conference on Computer graphics and interactive techniques
The Technology of Computer Music
The Technology of Computer Music
3D Sound Feedback Act as Task Aid in a Virtual Assembly Environment
TPCG '03 Proceedings of the Theory and Practice of Computer Graphics 2003
Sound-by-numbers: motion-driven sound synthesis
Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Interactive simulation of complex audiovisual scenes
Presence: Teleoperators and Virtual Environments - Special section: Advances in interactive multimodal telepresent systems
The use of visual and auditory feedback for assembly task performance in a virtual environment
Proceedings of the 21st spring conference on Computer graphics
Spatial sound localization in an augmented reality environment
OZCHI '06 Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments
Evaluation of auditory and visual feedback on task performance in a virtual assembly environment
Presence: Teleoperators and Virtual Environments - Special issue: 2004 workshop on VR design and evaluation
Rigid-body fracture sound with precomputed soundbanks
ACM SIGGRAPH 2010 papers
Haptic-auditory rendering and perception of contact stiffness
HAID'06 Proceedings of the First international conference on Haptic and Audio Interaction Design
| Hi-index | 0.00 |
Sounds are often the result of motions of virtual objects in a virtual environment. Therefore, sounds and the motions that caused them should be treated in an integrated way. When sounds and motions do not have the proper correspondence, the resultant confusion can lessen the effects of each. In this paper, we present an integrated system for modeling, synchronizing, and rendering sounds for virtual environments. The key idea of the system is the use of a functional representation of sounds, called timbre trees. This representation is used to model sounds that are parameterizable. These parameters can then be mapped to the parameters associated with the motions of objects in the environment. This mapping allows the correspondence of motions and sounds in the environment. Representing arbitrary sounds using timbre trees is a difficult process that we do not address in this paper. We describe approaches for creating some timbre trees including the use of genetic algorithms. Rendering the sounds in an aural environment is achieved by attaching special environmental nodes that represent the attenuation and delay as well as the listener effects to the timbre trees. These trees are then evaluated to generate the sounds. The system that we describe runs parallel in real time on an eight-processor SGI Onyx. We see the main contribution of the present system as a conceptual framework on which to consider the sound and motion in an integrated virtual environment.