Video-based tracking of user's motion for augmented desk interface

Authors:
Yoichi Sato;Kenji Oka;Hideki Koike;Yasuto Nakanishi
Affiliations:
Institute of Industrial Science, The University of Tokyo, Tokyo, Japan;Institute of Industrial Science, The University of Tokyo, Tokyo, Japan;Graduate School of Information Systems, University of Electro-Communications, Tokyo, Japan;Department of Computer, Information and Communication Science, Tokyo University of Agriculture and Technology, Tokyo, Japan
Venue:
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Year:
2004

Citing 13
Cited 1

Interacting with paper on the DigitalDesk

Communications of the ACM - Special issue on computer augmented environments: back to the real world
Augmenting reality: adding computational dimensions to paper

Communications of the ACM - Special issue on computer augmented environments: back to the real world
Retrieving electronic documents with real-world objects on InteractiveDESK

Proceedings of the 8th annual ACM symposium on User interface and software technology
Tangible bits: towards seamless interfaces between people, bits and atoms

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
CONDENSATION—Conditional Density Propagation forVisual Tracking

International Journal of Computer Vision
Augmented surfaces: a spatially continuous work space for hybrid computing environments

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system

ACM Transactions on Computer-Human Interaction (TOCHI)
Real-Time Fingertip Tracking and Gesture Recognition

IEEE Computer Graphics and Applications
Tele-Graffiti: A Camera-Projector Based Remote Sketching System with Hand-Based User Interface and Automatic Session Summarization

International Journal of Computer Vision
Fast Tracking of Hands and Fingertips in Infrared Images for Augmented Desk Interface

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
An Approach to Automatic Recognition of Spontaneous Facial Actions

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Real-Time Tracking of Multiple Fingertips and Gesture Recognition for Augmented Desk Interface Systems

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Two-handed drawing on augmented desk system

Proceedings of the Working Conference on Advanced Visual Interfaces

SATIRE: a software architecture for smart AtTIRE

Proceedings of the 4th international conference on Mobile systems, applications and services

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents an overview of our project on an augmented desk interface system called the EnhancedDesk. The EnhancedDesk is equipped with an infrared camera for tracking a users' hand motions, a color video camera for recognizing objects, and projectors for displaying various kinds of digital information onto the desk. The key technical innovations of the EnhancedDesk include: fast and accurate tracking of multiple fingers for direct manipulation of both real and projected objects with bare hands, interactive object registration and recognition with hand gestures, vision-based tracking of a user's gaze, and addition of interactive functionality overlaid on the desk. This paper presents a brief description of the components, as well as some prototypes of applications of our augmented desk interface system.