Fast finger tracking system for in-air typing interface

Authors:
Kazuhiro Terajima;Takashi Komuro;Masatoshi Ishikawa
Affiliations:
The University of Tokyo, Tokyo, Japan;The University of Tokyo, Tokyo, Japan;The University of Tokyo, Tokyo, Japan
Venue:
CHI '09 Extended Abstracts on Human Factors in Computing Systems
Year:
2009

Citing 5
Cited 2

Typing in thin air: the canesta projection keyboard - a new method of interaction with electronic devices

CHI '03 Extended Abstracts on Human Factors in Computing Systems
Using keyboards with head mounted displays

VRCAI '04 Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry
AirGrabber: virtual keyboard using miniature infrared camera and tilt sensor

Proceedings of the 2005 international conference on Augmented tele-existence
Model-Based Hand Tracking Using a Hierarchical Bayesian Filter

IEEE Transactions on Pattern Analysis and Machine Intelligence
UbiHand: a wearable input device for 3D interaction

ACM SIGGRAPH 2006 Research posters

Tracking-based interaction for object creation in mobile augmented reality

Proceedings of the 21st ACM international conference on Multimedia
A virtual touchscreen with depth recognition

AUIC '12 Proceedings of the Thirteenth Australasian User Interface Conference - Volume 126

Quantified Score

Hi-index	0.00

Visualization

Abstract

We developed a system which performs 3D motion tracking of human's hand and fingers from images of a single high-frame-rate camera and that recognizes his/her typing motion in the air. Our template-matching-based method using hand textures reduces background effect and enables markerless tracking. In addition, use of a high-frame-rate camera enables recognition of rapid typing motion which is difficult to track using standard cameras. In order to realize real-time recognition, we developed hardware which parallelizes and accelerates image processing. As a result, we achieved real-time recognition of typing motion with the throughput of 138 fps (frames per second) and the latency of 29 ms.