Initializing Markerless Tracking Using a Simple Hand Gesture
ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
A HIMI model for collaborative multi-touch multimedia education
AMC '09 Proceedings of the 2009 workshop on Ambient media computing
Proceedings of the 2nd International Conference on Interaction Sciences: Information Technology, Culture and Human
Fast hand detection using posture invariant constraints
KI'09 Proceedings of the 32nd annual German conference on Advances in artificial intelligence
Hand gesture for taking self portrait
HCII'11 Proceedings of the 14th international conference on Human-computer interaction: interaction techniques and environments - Volume Part II
A real-time bimanual 3D interaction method based on bare-hand tracking
MM '11 Proceedings of the 19th ACM international conference on Multimedia
An interface between users and virtual objects using two hands
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
HoloDesk: direct 3d interactions with a situated see-through display
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A line-based palm-top detector for mobile augmented reality
Proceedings of the International Working Conference on Advanced Visual Interfaces
Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor
Proceedings of the 25th annual ACM symposium on User interface software and technology
Proceedings of the 24th Australian Computer-Human Interaction Conference
Proceedings of the 27th Conference on Image and Vision Computing New Zealand
Real-Time markerless hand gesture recognition with depth camera
PCM'12 Proceedings of the 13th Pacific-Rim conference on Advances in Multimedia Information Processing
Expert Systems with Applications: An International Journal
3DTouch and HOMER-S: intuitive manipulation techniques for one-handed handheld augmented reality
Proceedings of the Virtual Reality International Conference: Laval Virtual
Seeing double: reconstructing obscured typed input from repeated compromising reflections
Proceedings of the 2013 ACM SIGSAC conference on Computer & communications security
Free-hand interaction for handheld augmented reality using an RGB-depth camera
SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications
Real-time Hand Gesture Recognition from Depth Images Using Convex Shape Decomposition Method
Journal of Signal Processing Systems
Hand shape classification using depth data for unconstrained 3D interaction
Journal of Ambient Intelligence and Smart Environments - Ambient and Smart Component Technologies for Human Centric Computing
Hi-index | 0.00 |
We present markerless camera tracking and user interface methodology for readily inspecting augmented reality (AR) objects in wearable computing applications. Instead of a marker, we use the human hand as a distinctive pattern that almost all wearable computer users have readily available. We present a robust real-time algorithm that recognizes fingertips to reconstruct the six-degree-of-freedom camera pose relative to the user's outstretched hand. A hand pose model is constructed in a one-time calibration step by measuring the fingertip positions in presence of ground-truth scale information. Through frame-by-frame reconstruction of the camera pose relative to the hand, we can stabilize 3D graphics annotations on top of the hand, allowing the user to inspect such virtual objects conveniently from different viewing angles in AR. We evaluate our approach with regard to speed and accuracy, and compare it to state-of-the-art marker-based AR systems. We demonstrate the robustness and usefulness of our approach in an example AR application for selecting and inspecting world-stabilized virtual objects.