The metaDESK: models and prototypes for tangible user interfaces
Proceedings of the 10th annual ACM symposium on User interface software and technology
Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review
IEEE Transactions on Pattern Analysis and Machine Intelligence
Using transparent props for interaction with the virtual table
I3D '99 Proceedings of the 1999 symposium on Interactive 3D graphics
Realizing 3D visualization using crossed-beam volumetric displays
Communications of the ACM
Multiple view geometry in computer visiond
Multiple view geometry in computer visiond
DiamondTouch: a multi-user touch technology
Proceedings of the 14th annual ACM symposium on User interface software and technology
Designing a human-centered, multimodal GIS interface to support emergency management
Proceedings of the 10th ACM international symposium on Advances in geographic information systems
Real-Time Fingertip Tracking and Gesture Recognition
IEEE Computer Graphics and Applications
Multimodal interaction techniques for the virtual workbench
CHI '99 Extended Abstracts on Human Factors in Computing Systems
High precision touch screen interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User Hints for Directed Graph Drawing
GD '01 Revised Papers from the 9th International Symposium on Graph Drawing
VR '99 Proceedings of the IEEE Virtual Reality
VR '00 Proceedings of the IEEE Virtual Reality 2000 Conference
A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
An Introduction to the Kalman Filter
An Introduction to the Kalman Filter
Bare-hand human-computer interaction
Proceedings of the 2001 workshop on Perceptive user interfaces
Multi-finger gestural interaction with 3d volumetric displays
Proceedings of the 17th annual ACM symposium on User interface software and technology
An interactive multi-user system for simultaneous graph drawing
GD'04 Proceedings of the 12th international conference on Graph Drawing
| Hi-index | 0.00 |
The augmented desk is gaining popularity in recent HCI research. Its layout of a large horizontal screen on the desk enhances immersive and intense collaborative experiences. A responsive and unimpeded input interface is important for an efficient interaction in such an environment. In this paper, we developed a real-time stereo vision-based finger pointing interface for our augmented desk that supports drag-and-drop operation by the tap-and-move of the index finger. The core of our system is a 3D fingertip tracking system, which requires both careful calibration and efficient fingertip localization algorithm. To meet these requirements, we have designed a two-step calibration method that strikes a good balance between accuracy and convenience. Furthermore, based on the chain code representation of the contour, we propose the direction cancellation vector as a tool for fingertip localization. Our algorithm works efficiently with a time complexity of O(n) in term of the length of the chain code. Currently our system allows a user to select and move the displayed contents on the screen directly using his fingertip, and it is applied to the interactive graph drawing paradigm proposed by do Nascimento and Eades (2001). In this application, our real-time pointing interface enables the user to interact with a graph drawing program dynamically, which results in optimal layouts of graphs with maximum symmetry. In the last section, the strength and weakness of our system are discussed, and further suggestions to improve the system are also given.