An immersive, multi-user, musical stage environment

Authors:
Matthew Reynolds;Bernd Schoner;Joey Richards;Kelly Dobson;Neil Gershenfeld
Affiliations:
Physics and Media Group, MIT Media Laboratory, 20 Ames Street, Cambridge, MA;ThingMagic LLC, Cambridge, MA;Trimble Navigation Ltd, Sunnyvale, CA;Physics and Media Group, MIT Media Laboratory, 20 Ames Street, Cambridge, MA;Physics and Media Group, MIT Media Laboratory, 20 Ames Street, Cambridge, MA
Venue:
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Year:
2001

Citing 7
Cited 5

SCAAT: incremental tracking with incomplete information

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Constellation: a wide-range wireless motion-tracking system for augmented reality and virtual set applications

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Electronic music: new ways to play

IEEE Spectrum
The nature of mathematical modeling

The nature of mathematical modeling
The HiBall Tracker: high-performance wide-area tracking for virtual and augmented environments

Proceedings of the ACM symposium on Virtual reality software and technology
Interfacing to the foot: apparatus and applications

CHI '00 Extended Abstracts on Human Factors in Computing Systems
An installation of interactive furniture

IBM Systems Journal

Techniques for Interactive Audience Participation

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Augmented Reality Chinese Checkers

Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology
Cooperative gestures: multi-user gestural interactions for co-located groupware

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An immersive multiuser music generation interface

Proceedings of the International Conference on Advances in Computer Enterntainment Technology
Evaluation on performer support methods for interactive performances using projector

Journal of Mobile Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

A multi-user, polyphonic sensor stage environment that maps position and gestures of up to four performers to the pitch and articulation of distinct notes is presented. The design seeks to provide multiple players on a stage with the feeling of a traditional acoustic instrument by giving them complete control over the instrument's expressive parameters and a clear causal connection between their actions and the resulting sound. The positions of the performers are determined by a custom ultrasonic tracking system, while hand motions are measured by custom-made gloves containing accelerometer units. Furthermore, juggling clubs are illuminated dynamically to make complex juggling patterns more apparent. The system is currently on tour with the Flying Karamazov Brothers juggling troupe.