Multimodal interaction with a virtual character in interactive storytelling

Authors:
Nikolaus Bee;Johannes Wagner;Elisabeth André;Fred Charles;David Pizzi;Marc Cavazza
Affiliations:
Augsburg University, Augsburg, Germany;Augsburg University, Augsburg, Germany;Augsburg University, Augsburg, Germany;University of Teesside, Middlesbrough, United Kingdom;University of Teesside, Middlesbrough, United Kingdom;University of Teesside, Middlesbrough, United Kingdom
Venue:
Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems: volume 1 - Volume 1
Year:
2010

Citing 5
Cited 1

Hamlet on the Holodeck: The Future of Narrative in Cyberspace

Hamlet on the Holodeck: The Future of Narrative in Cyberspace
Presence and engagement in an interactive drama

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Madame bovary on the holodeck: immersive interactive storytelling

Proceedings of the 15th international conference on Multimedia
Simplified facial animation control utilizing novel input devices: a comparative study

Proceedings of the 14th international conference on Intelligent user interfaces
Emotional input for character-based interactive storytelling

Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 1

Adaptive eye gaze patterns in interactions with human and artificial agents

ACM Transactions on Interactive Intelligent Systems (TiiS)

Quantified Score

Hi-index	0.00

Visualization

Abstract

A number of interactive storytelling (IS) systems offer the user the possibility to input natural language input which determines how a story progresses. We introduce a framework for real-time signal processing (SSI) to analyze the users' state which then can influence the feelings of the story characters and their actions in the story. SSI is not only used to enable more natural character responses that are sensitive to the user's state at runtime. In addition SSI offers the possibility to collect a large variety of synchronized user data which can be used to analyze the user's experience in offline mode. The underlying narrative in which the approach was tested is based on a classical XIXth century psychological novel: Madame Bovary, by Flaubert.