Estimating virtual touchscreen for fingertip interaction with large displays

Authors:
Kelvin Cheng;Masahiro Takatsuka
Affiliations:
The University of Sydney, Australia;The University of Sydney, Australia
Venue:
OZCHI '06 Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments
Year:
2006

Citing 5
Cited 4

Real-Time Fingertip Tracking and Gesture Recognition

IEEE Computer Graphics and Applications
Pointing gesture recognition based on 3D-tracking of face, hands and head orientation

Proceedings of the 5th international conference on Multimodal interfaces
Real-time monocular tracking of view frustum for large screen human-computer interaction

ACSC '05 Proceedings of the Twenty-eighth Australasian conference on Computer Science - Volume 38
Transparent eye contact and gesture videoconference

International Journal of Wireless and Mobile Computing
Visual capture and understanding of hand pointing actions in a 3-D environment

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Initial evaluation of a bare-hand interaction technique for large displays using a webcam

Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems
An Optical Pen Tracking System as Alternative Pointing Device

INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II
Optical touch screen with virtual force

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
Single camera-based remote pointing and recognition for monitor-based augmented reality surgical systems

Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry

Quantified Score

Hi-index	0.00

Visualization

Abstract

Large displays are everywhere. However, the computer mouse remains the most common interaction tool for such displays. We propose a new approach for fingertip interaction with large display systems using monocular computer vision. By taking into account the location of the user and the interaction area available, we can estimate an interaction surface - virtual touchscreen - between the display and the user. Users can use their pointing finger to interact with the display as if it was brought forward and presented directly in front of them, while preserving viewing angle. An interaction model is presented to describe the interaction with the virtual touchscreen, using the head-hand line method. Initial results, in the form of a work-in-progress prototype, demonstrate the feasibility of this concept.