Multimodal Acting in Mixed Reality Interactive Storytelling

Authors:
Marc Cavazza;Fred Charles;Steven J. Mead;Olivier Martin;Xavier Marichal;Alok Nandi
Affiliations:
University of Teesside;University of Teesside;University of Teesside;Université Catholique de Louvain;Alterface;Alterface
Venue:
IEEE MultiMedia
Year:
2004

Citing 6
Cited 16

Ten myths of multimodal interaction

Communications of the ACM
Toward the holodeck: integrating graphics, sound, character and story

Proceedings of the fifth international conference on Autonomous agents
Character-Based Interactive Storytelling

IEEE Intelligent Systems
SHOP: Simple Hierarchical Ordered Planner

IJCAI '99 Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence
The invisible person: advanced interaction using an embedded interface

EGVE '03 Proceedings of the workshop on Virtual environments 2003
Shadow identification and classification using invariant color models

ICASSP '01 Proceedings of the Acoustics, Speech, and Signal Processing, 2001. on IEEE International Conference - Volume 03

The Synthetic Character Ritchie: First Steps Towards a Virtual Companion for Mixed Reality

ISMAR '05 Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality
MonkeyBridge: autonomous agents in augmented reality games

Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology
Engaging in a Conversation with Synthetic Agents along the Virtuality Continuum

IAT '06 Proceedings of the IEEE/WIC/ACM international conference on Intelligent Agent Technology
Engaging in a Conversation with Synthetic Agents along the Virtuality Continuum

WI '06 Proceedings of the 2006 IEEE/WIC/ACM International Conference on Web Intelligence
Human computer interaction based on hand gesture ontology

ICCOMP'07 Proceedings of the 11th WSEAS International Conference on Computers
Exploring emotions and multimodality in digitally augmented puppeteering

AVI '08 Proceedings of the working conference on Advanced visual interfaces
Integrating a Virtual Agent into the Real World: The Virtual Anatomy Assistant Ritchie

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Interactive Storytelling with Literary Feelings

ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction
An Interactive Painting System by Using Enhanced Auto-positioning and Pattern Matching Techniques

PCM '08 Proceedings of the 9th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Controlling Narrative Generation with Planning Trajectories: The Role of Constraints

ICIDS '09 Proceedings of the 2nd Joint International Conference on Interactive Digital Storytelling: Interactive Storytelling
Engaging spect-actors with multimodal digital puppetry

Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Augmented reality agents in the development pipeline of computer entertainment

ICEC'05 Proceedings of the 4th international conference on Entertainment Computing
Engaging in a conversation with synthetic characters along the virtuality continuum

SG'05 Proceedings of the 5th international conference on Smart Graphics
An event-driven, stochastic, undirected narrative (EDSUN) framework for interactive contents

TIDSE'06 Proceedings of the Third international conference on Technologies for Interactive Digital Storytelling and Entertainment
Draw your own story: paper and pencil interactive storytelling

ICEC'11 Proceedings of the 10th international conference on Entertainment Computing
Social interaction for interactive storytelling

ICEC'12 Proceedings of the 11th international conference on Entertainment Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

An experimental mixed reality using a multimodal approach lets users play characters in interactive narratives as though acting on a stage. Users interact with characters through speech, attitude, and gesture, enhancing their immersion in the virtual world.