Dancing the night away: controlling a virtual karaoke dancer by multimodal expressive cues

Authors:
Matthias Rehm;Thurid Vogt;Michael Wissner;Nikolaus Bee
Affiliations:
University of Augsburg, Augsburg, Germany;University of Augsburg, Augsburg, Germany;University of Augsburg, Augsburg, Germany;University of Augsburg, Augsburg, Germany
Venue:
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 3
Year:
2008

Citing 8
Cited 3

Specifying gestures by example

Proceedings of the 18th annual conference on Computer graphics and interactive techniques
An investigation of the effectiveness of choreography for the portrayal of mood in virtual environments

AGENTS '00 Proceedings of the fourth international conference on Autonomous agents
The production and recognition of emotions in speech: features and algorithms

International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
Multimodal expressive embodied conversational agents

Proceedings of the 13th annual ACM international conference on Multimedia
Virtual rap dancer: invitation to dance

CHI '06 Extended Abstracts on Human Factors in Computing Systems
Movement-based interactive dance performance

MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Too close for comfort?: adapting to the user's cultural background

Proceedings of the international workshop on Human-centered multimedia
Multimodal sensing, interpretation and copying of movements by a virtual agent

PIT'06 Proceedings of the 2006 international tutorial and research conference on Perception and Interactive Technologies

EmoVoice -- A Framework for Online Recognition of Emotions from Voice

PIT '08 Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems
Emotional input for character-based interactive storytelling

Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
Some Pitfalls for Developing Enculturated Conversational Agents

Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this article, we propose an approach of nonverbal interaction with virtual agents to control agents' behavioral expressivity by extracting and combining acoustic and gestural features. The goal for this approach is twofold, (i) expressing individual features like situated arousal and personal style and (ii) transmitting this information in an immersive 3D environment by suitable means.