Affective computing
Emotion and sociable humanoid robots
International Journal of Human-Computer Studies - Application of affective computing in humanComputer interaction
Women, Art, and Technology
Fusing movement, sound, and video in Falling Up, an interactive dance/theatre production
NIME '02 Proceedings of the 2002 conference on New interfaces for musical expression
Sensemble: a wireless, compact, multi-user sensor system for interactive dance
NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Hi-index | 0.01 |
Early in Tod Machover's opera Death and the Powers, the main character, Simon Powers, is subsumed into a technological environment of his own creation. The theatrical set comes alive in the form of robotic, visual, and sonic elements that allow the actor to extend his range and influence across the stage in unique and dynamic ways. This environment must compellingly assume the behavior and expression of the absent Simon. In order to distill the essence of this character, we recover performance parameters in real time from physiological sensors, voice, and vision systems. These gesture and performance parameters are then mapped to a visual language that incorporates cognitive and semantic models informed by modal relationships. This language allows the off-stage actor to express emotion and interact with others on stage. Our Disembodied Performance system takes a new direction in augmented performance by employing a non-representational abstraction of a human presence that fully translates a character into an environment.