AVIE: a versatile multi-user stereo 360° interactive VR theatre
EDT '07 Proceedings of the 2007 workshop on Emerging displays technologies: images and beyond: the future of displays and interacton
Immersive Mixed Media Augmented Reality Applications and Technology
PCM '09 Proceedings of the 10th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Zirkonium: Non-invasive software for sound spatialisation*
Organised Sound
| Hi-index | 0.00 |
This paper describes a new sound spatialisation system which is an integral part of Rensselaer Polytechnic Institute’s new Experimental Media and Performing Arts Center (EMPAC). The Cinematic Spatial Sound Display (CSSD) was originally conceived for interactive panorama video installations, but the architecture goes beyond this particular application. The CSSD is characterised by its scalability to various loudspeaker configurations. It spatialises sound from dry sound files or live sources using control data that describe the spatial scenes. The time lines for source positions and other experimental parameters can be stored and edited in the CSSD, and the system can also process live user input to control selected parameters. The CSSD is more than just a sound positioning tool, and the underlying Virtual Microphone Control (ViMiC) technology was developed to support artists in designing new forms of spatial imagery. The software enables the user to create computer-generated rooms with virtual microphones and sound sources. The algorithm uses physical laws to auralise acoustic scenes – allowing realistic effects such as the Doppler shift and the simulation of various classical microphone techniques. Various parameters of ViMiC can be adjusted in real time, including the directivity patterns and orientations of both the microphones and sound sources as well as their precise locations. Surreal scenes can be created by assigning artificial directivity patterns to microphones or changing the laws of physics in the model. An algorithm to extract the sound-source positions in recordings using a microphone array is also part of the CSSD. The algorithm was specifically designed to operate in multiple sound-source scenarios and can also be used for telematic music applications.