Ghost fingers: a hybrid approach to the interaction with remote displays

Authors:
Seung Wook Kim;Stefan Marti
Affiliations:
Hewlett-Packard, Sunnyvale, California, USA;Hewlett-Packard, Sunnyvale, California, USA
Venue:
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Year:
2012

Citing 3
Cited 0

VideoDraw: a video interface for collaborative drawing

CHI '90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Lucid touch: a see-through mobile device

Proceedings of the 20th annual ACM symposium on User interface software and technology
RemoteTouch: touch-screen-like interaction in the tv viewing environment

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we describe a novel interaction method called Ghost Fingers, which enables efficient and intuitive switching between keyboard and multi-touch input on systems where the display is out of arm's reach. In addition, Ghost Fingers provides a translucent real-time visualization of the fingers and hands on the remote display, creating a closed interaction loop that enables direct manipulation even on remote displays. Our solution includes a wireless keyboard with attached imaging sensor that is used to both determine the position of the user's hand and fingers, and to provide a real-time translucent overlay of hand and fingers over the remote UI.