A framework for immersive spatial audio performance

Authors:
Mike Wozniewski;Zack Settel;Jeremy R. Cooperstock
Affiliations:
McGill University, Montreal, Quebec;La Société Des Arts Technologiques, Montreal, Quebec;McGill University, Montreal, Quebec
Venue:
NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Year:
2006

Citing 7
Cited 1

Surround-screen projection-based virtual reality: the design and implementation of the CAVE

SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
3-D sound for virtual reality and multimedia

3-D sound for virtual reality and multimedia
Real-time spatial processing of sounds for music, multimedia and interactive human-computer interfaces

Multimedia Systems - Special issue on audio and multimedia
Modeling acoustics in virtual environments using the uniform theory of diffraction

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Spatialized audio rendering for immersive virtual environments

VRST '02 Proceedings of the ACM symposium on Virtual reality software and technology
Problems and prospects for intimate musical control of computers

NIME '01 Proceedings of the 2001 conference on New interfaces for musical expression
Experiments with virtual reality instruments

NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression

Gesture Control of Sound Spatialization for Live Musical Performance

Gesture-Based Human-Computer Interaction and Simulation

Quantified Score

Hi-index	0.00

Visualization

Abstract

Traditional uses of virtual audio environments tend to focus on perceptually accurate acoustic representations. Though spatialization of sound sources is important, it is necessary to leverage control of the sonic representation when considering musical applications. The proposed framework allows for the creation of perceptually immersive scenes that function as musical instruments. Loudspeakers and microphones are modeled within the scene along with the listener/performer, creating a navigable 3D sonic space where sound sources and sinks process audio according to user-defined spatial mappings.