The Singing Tree:: design of an interactive musical interface
DIS '97 Proceedings of the 2nd conference on Designing interactive systems: processes, practices, methods, and techniques
VRPN: a device-independent, network-transparent VR peripheral system
VRST '01 Proceedings of the ACM symposium on Virtual reality software and technology
2 performances in the 21st century virtual color organ
C&C '02 Proceedings of the 4th conference on Creativity & cognition
In-situ speech visualization in real-time interactive installation and performance
Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering
The ANIMUS project: a framework for the creation of interactive creatures in immersed environments
Proceedings of the ACM symposium on Virtual reality software and technology
A perception and selective attention system for synthetic creatures
SG'03 Proceedings of the 3rd international conference on Smart graphics
Virtual rap dancer: invitation to dance
CHI '06 Extended Abstracts on Human Factors in Computing Systems
The soundtrack of your mind: mind music - adaptive audio for game characters
Proceedings of the 2006 ACM SIGCHI international conference on Advances in computer entertainment technology
Music-driven character animation
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Counterlines: a duet for piano and pen display
CHI '10 Extended Abstracts on Human Factors in Computing Systems
Copying behaviour of expressive motion
MIRAGE'07 Proceedings of the 3rd international conference on Computer vision/computer graphics collaboration techniques
Interaction with a virtual character through performance based animation
SG'10 Proceedings of the 10th international conference on Smart graphics
From acoustic cues to an expressive agent
GW'05 Proceedings of the 6th international conference on Gesture in Human-Computer Interaction and Simulation
Interacting with a virtual rap dancer
INTETAIN'05 Proceedings of the First international conference on Intelligent Technologies for Interactive Entertainment
Visualizing emotion in musical performance using a virtual character
SG'05 Proceedings of the 5th international conference on Smart Graphics
| Hi-index | 0.00 |
We present a real-time system which allows musicians to interact with synthetic virtual characters as they perform. Using Max/MSP to parameterize keyboard and vocal input, meaningful features (pitch, amplitude, chord information, and vocal timbre) are extracted from live performance in real-time. These extracted musical features are then mapped to character behaviour in such a way that the musician's performance elicits a response from the virtual character. The system uses the ANIMUS framework to generate believable character expressions. Experimental results are presented for simple characters.