Computational geometry: algorithms and applications
Computational geometry: algorithms and applications
The algorithm design manual
Evolutionary Design by Computers with CDrom
Evolutionary Design by Computers with CDrom
Towards some organising principles for musical program auralisations
ICAD'98 Proceedings of the 1998 international conference on Auditory Display
Hyper-shaku (Border-Crossing): towards the multi-modal gesture-controlled hyper-instrument
NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
| Hi-index | 0.00 |
Information representation in augmented and virtual reality systems, and social physical (building) spaces can enhance the efficacy of interacting with and assimilating abstract, non-visual data. Sonification is the process of automatically generated real time information representation. There is a gap in our implementation and knowledge of auditory display systems used to enhance interaction in virtual and augmented reality. This paper addresses that gap by examining methodologies for mapping socio-spatial data to spatialised sonification manipulated with gestural controllers. This is a system of interactive knowledge representation that completes the human integration loop, enabling the user to interact with and manipulate data using 3D spatial gesture and 3D auditory display. Benefits include 1) added immersion in an augmented or virtual reality interface; 2) auditory display avoids visual overload in visually-saturated processes such as designing, evacuation in emergencies, flying aircraft; computer gaming; and 3) bi-modal or auditory representation, due to its time-based character, facilitates cognition of complex information.