HIP-storytelling: hand interactive projection for storytelling

Authors:
Narciso Melo;Pedro Salgado;Ido Iurgel;Pedro Branco
Affiliations:
engageLab, University of Minho, Guimarães, Portugal;engageLab, University of Minho, Guimarães, Portugal;engageLab, University of Minho, Guimarães, Portugal;engageLab, University of Minho, Guimarães, Portugal
Venue:
ICIDS'11 Proceedings of the 4th international conference on Interactive Digital Storytelling
Year:
2011

Citing 2
Cited 0

Tangible viewpoints: a physical approach to multimedia stories

Proceedings of the tenth ACM international conference on Multimedia
Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces, and Cross-Modal Sensory Illusions

Presence: Teleoperators and Virtual Environments

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have created an interactive storytelling system for public spaces that is collaborative, easy and entertaining to use, and allows for a natural interaction. The system consists of a table, a ceiling mounted projector that projects onto the table, and a 3D camera for tracking hands and for object recognition. The main feature of the system is the projection on top of the palm of the hand of the users; thus, the hand becomes also a viewing surface. This allows for very natural gestural interaction, such as holding and passing objects between users. For example, in the course of narrative, users can hand over a story character or object to each other. We also employ projection based augmented reality to animate real objects on the table. Apart from entertainment, the system shall be employed for concrete educational interactive storytelling applications in public spaces.