Interacting with a tabletop display using a camera equipped mobile phone

Authors:
Seokhee Jeon;Gerard J. Kim;Mark Billinghurst
Affiliations:
VRPM Lab., Dept. of CSE, POSTECH, Korea;DXP Lab., Dept. of CSE, Korea University, Korea;HIT Lab NZ, University of Canterbury, New Zealand
Venue:
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction platforms and techniques
Year:
2007

Citing 7
Cited 0

Virtual reality for palmtop computers

ACM Transactions on Information Systems (TOIS)
First Steps Towards Handheld Augmented Reality

ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
A camera-based interface for interaction with mobile handheld computers

Proceedings of the 2005 symposium on Interactive 3D graphics and games
Foot-based mobile interaction with games

Proceedings of the 2004 ACM SIGCHI International Conference on Advances in computer entertainment technology
New Directions in 3D User Interfaces

VR '05 Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality
Efficient, causal camera tracking in unprepared environments

Computer Vision and Image Understanding
A conceptual framework for camera phone-based interaction techniques

PERVASIVE'05 Proceedings of the Third international conference on Pervasive Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Today's mobile phones have not only become the most representative device in the new ubiquitous computing era but also dramatically improved in terms of their multi-modal sensing and display capabilities. This advance makes the mobile phone an ideal candidate for a more natural interaction device in ubiquitous computing environment. This paper proposes techniques which use camera-equipped mobile phones for interacting with 2D and 3D applications on a tabletop display environment. The camera acts as the main sensor for a gesture-based interaction. Using the mobile phone with an interactive touch screen allows the use of techniques that move beyond single hand/finger input to improve task performance. The interaction performances of the proposed techniques and design guidelines are also described in this paper.