Twinkle: Interacting with physical surfaces using handheld projector

Authors:
Takumi Yoshida;Yuki Hirobe;Hideaki Nii;Naoki Kawakami;Susumu Tachi
Affiliations:
Univ. of Tokyo, Tokyo, Japan;Univ. of Tokyo, Tokyo, Japan;Keio Univ., Yokohama, Japan;Univ. of Tokyo, Tokyo, Japan;Keio Univ., Yokohama, Japan
Venue:
VR '10 Proceedings of the 2010 IEEE Virtual Reality Conference
Year:
2010

Citing 0
Cited 7

Character interaction with handheld projectors

Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction
Motionbeam: a metaphor for character interaction with handheld projectors

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
PoCoMo: projected collaboration using mobile devices

Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services
A pre-history of handheld projector-based interaction

Personal and Ubiquitous Computing
Wall Play: a novel wall/floor interaction concept for mobile projected gaming

MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion
Usability of one-handed interaction methods for handheld projection-based augmented reality

Personal and Ubiquitous Computing
HideOut: mobile projector interaction with tangible objects and surfaces

Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

We propose a novel interface called Twinkle for interacting with an arbitrary physical surface using a handheld projector and a camera. When a user flashes a projection light on an object, the projected images react as if the user touched the object with the light. The handheld device recognizes the features of the physical environment and displays images and sounds that are generated in real-time according to the user's motion and collisions of projected images with objects. We realize this system by using several image-processing techniques and a collision detection algorithm. We also use an acceleration sensor to compensate for the image processing. In this paper, we explain the principle of interacting with a physical surface. Then, we describe the implementation of the prototype system and some application examples.