Initializing Markerless Tracking Using a Simple Hand Gesture

Authors:
Taehee Lee;Tobias Hollerer
Affiliations:
Four Eyes Laboratory, Department of Computer Science, University of California, Santa Barbara, California 93106 USA. e-mail: taehee@cs.ucsb.edu, taehee@cs.ucla.edu;Four Eyes Laboratory, Department of Computer Science, University of California, Santa Barbara, California 93106 USA. e-mail: holl@cs.ucsb.edu
Venue:
ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
Year:
2007

Citing 7
Cited 3

A Flexible New Technique for Camera Calibration

IEEE Transactions on Pattern Analysis and Machine Intelligence
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System

IWAR '99 Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
ARTag, a Fiducial Marker System Using Digital Techniques

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
MonoSLAM: Real-Time Single Camera SLAM

IEEE Transactions on Pattern Analysis and Machine Intelligence
Handy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking

ISWC '07 Proceedings of the 2007 11th IEEE International Symposium on Wearable Computers

Manipulation of virtual objects in marker-less AR system by fingertip tracking and hand gesture recognition

Proceedings of the 2nd International Conference on Interaction Sciences: Information Technology, Culture and Human
BioMetal glove

Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology
Alerting accidents with ambiguity: a tangible tabletop application for safe and independent chemistry experiments

UIC'10 Proceedings of the 7th international conference on Ubiquitous intelligence and computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

We introduce a technique to establish a coordinate system for augmented reality (AR) on tabletop environments. A user's hand is tracked and the fingertips on the outstretched hand are detected, providing a camera pose estimation relative to the hand. As a user places the hand on the surface of a tabletop environment, the hand's coordinate system is propagated to the environment, detecting distinctive image features in the scene. The features are tracked fast and robustly using optical flow. In this way, a new tabletop AR environment is set up without having to carry a marker or a sophisticated tracking system to the environment itself. We also demonstrate a proof-of-concept application for establishing a tabletop AR environment and recognizing a scene when detecting its features.