Game/music interaction: an aural interface for immersive interactive environments

Authors:
Chris Nelson;Burkhard C. Wünsche
Affiliations:
Boston University, Boston, MA;University of Auckland, Auckland, New Zealand
Venue:
AUIC '07 Proceedings of the eight Australasian conference on User interface - Volume 64
Year:
2007

Citing 4
Cited 1

LISTEN: sounding uncertainty visualization

Proceedings of the 7th conference on Visualization '96
A system for the complementary visualization of 3D volume images using 2D and 3D binaurally processed sonification representations

Proceedings of the 7th conference on Visualization '96
In the mixxx: novel digital DJ interfaces

CHI '05 Extended Abstracts on Human Factors in Computing Systems
Information visualisation utilising 3D computer game engines case study: a source code comprehension tool

CHINZ '05 Proceedings of the 6th ACM SIGCHI New Zealand chapter's international conference on Computer-human interaction: making CHI natural

Interactive control of music using emotional body expressions

CHI '08 Extended Abstracts on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Game music has the potential to be much more than a passive element of the background. The music can and should affect the game play. The game play can and should affect the music. The player's actions can and should influence the direction and evolution of the music. By tightly linking game play and music, the player becomes much more immersed in the experience, and new creative possibilities abound for the developer. This paper presents a framework for linking game play to music by analysing music on a perceptual and a physical level. Real-time processing is achieved by using the GPU as an APU. The usefulness of the framework is demonstrated by two examples of game play synchronised with auditory perceptions. It is our hope that this paper will enable and stimulate the reader to create musically interactive games, and discovering entirely new ideas in this field.