Interactive sonification of neural activity

Authors:
Gil Weinberg;Travis Thatcher
Affiliations:
Georgia Institute of Technology, McMillan St. Atlanta, GA;Georgia Institute of Technology, McMillan St. Atlanta, GA
Venue:
NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Year:
2006

Citing 1
Cited 0

prefuse: a toolkit for interactive information visualization

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

We discuss our ongoing research in sonification of neural activity as demonstrated in the "Fish and Chips" and "BrainWaves" projects. We argue that sonification can serve as an effective technique for the representation of complex spatial information such as neural activity due to the auditory system's ability to perceive stimuli at a wide spatial cover and its inclination to perceive spatial patterns in sonic input. The paper discusses aesthetic and functional aspects of sonification in this context and describes the evolution of our technique, artistic approach, and interaction design -- from the low-resolution graphical user interface in "Fish and Chips" to the high-resolution tangible interaction with newly developed controllers in "BrainWaves". We conclude with an evaluative discussion and a number of suggestions for future work.