An iterative design methodology for user-friendly natural language office information applications
ACM Transactions on Information Systems (TOIS)
Computer puppetry: An importance-based approach
ACM Transactions on Graphics (TOG)
Interactive control of avatars animated with human motion data
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
IEEE Computer Graphics and Applications
Educating via entertainment media: the Sesame Workshop approach
Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment
Presence: Teleoperators and Virtual Environments
Wizard of Oz Support throughout an Iterative Design Process
IEEE Pervasive Computing
Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games
International Journal of Human-Computer Studies
I'm in the game: embodied puppet interface improves avatar control
Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction
Realtime performance-based facial animation
ACM SIGGRAPH 2011 papers
Animatronic shader lamps avatars
Virtual Reality - Special Issue on Augmented Reality
Interactive performance: dramatic improvisation in a mixed reality environment for learning
Proceedings of the 2011 international conference on Virtual and mixed reality: systems and applications - Volume Part II
Geppetto: an environment for the efficient control and transmission of digital puppetry
Proceedings of the 2011 international conference on Virtual and mixed reality: systems and applications - Volume Part II
Anim-actor: understanding interaction with digital puppetry using low-cost motion capture
Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology
3D puppetry: a kinect-based interface for 3D animation
Proceedings of the 25th annual ACM symposium on User interface software and technology
Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
Designing digital puppetry systems: guidelines and best practices
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Hi-index | 0.00 |
This paper presents an architecture to control avatars and virtual characters in remote interaction environments. A human-in-the-loop (interactor) metaphor provides remote control of multiple virtual characters, with support for multiple interactors and multiple observers. Custom animation blending routines and a gesture-based interface provide interactors with an intuitive digital puppetry paradigm. This paradigm reduces the cognitive and physical loads on the interactor while supporting natural bi-directional conversation between a user and the virtual characters or avatar counterparts. A multi-server-client architecture, based on a low-demand network protocol, connects the user environment, interactor station(s) and observer station(s). The associated system affords the delivery of personalized experiences that adapt to the actions and interactions of individual users, while staying true to each virtual character's personality and backstory. This approach has been used to create experiences designed for training, education, rehabilitation, remote presence and other-related applications.