Direct pointer: direct manipulation for large-display interaction using handheld cameras

Authors:
Hao Jiang;Eyal Ofek;Neema Moraveji;Yuanchun Shi
Affiliations:
Tsinghua University, Beijing, China;Microsoft Research Asia, Beijing, China;Microsoft Research Asia, Beijing, China;Tsinghua University, Beijing, China
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2006

Citing 6
Cited 12

Accuracy measures for evaluating computer pointing devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Laser pointer interaction

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An Evaluation of Two Input Devices for Remote Pointing

EHCI '01 Proceedings of the 8th IFIP International Conference on Engineering for Human-Computer Interaction
VisionWand: interaction techniques for large displays using a passive wand tracked in 3D

Proceedings of the 16th annual ACM symposium on User interface software and technology
C-blink: a hue-difference-based light signal marker for large screen interaction via any mobile terminal

Proceedings of the 17th annual ACM symposium on User interface software and technology
Sweep and point and shoot: phonecam-based interactions for large public displays

CHI '05 Extended Abstracts on Human Factors in Computing Systems

Designing and evaluating mobile phone-based interaction with public displays

CHI '08 Extended Abstracts on Human Factors in Computing Systems
Creating and sharing multi-media packages using large situated public displays and mobile phones

Proceedings of the 9th international conference on Human computer interaction with mobile devices and services
An empirical comparison of "wiimote" gun attachments for pointing tasks

Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems
Using handheld devices for mobile interaction with displays in home environments

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Flashlight interaction: a study on mobile phone interaction techniques with large displays

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
BlueTone: a framework for interacting with public displays using dual-tone multi-frequency through bluetooth

Proceedings of the 11th international conference on Ubiquitous computing
ARC-Pad: absolute+relative cursor positioning for large displays with a mobile touchscreen

Proceedings of the 22nd annual ACM symposium on User interface software and technology
Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays

OZCHI '09 Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7
A human motor behavior model for distal pointing tasks

International Journal of Human-Computer Studies
The ambient media player: a media application remotely operated by the use of mobile devices and gestures

Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia
Augmented visualization with natural feature tracking

Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia
Plug&touch: a mobile interaction solution for large display via vision-based hand gesture detection

Proceedings of the 20th ACM international conference on Multimedia

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper describes the design and evaluation of a technique, Direct Pointer, that enables users to interact intuitively with large displays using cameras equipped on handheld devices, such as mobile phones and personal digital assistant (PDA). In contrast to many existing interaction methods that attempt to address the same problem, ours offers direct manipulation of the pointer position with continuous visual feedback. The primary advantage of this technique is that it only requires equipment that is readily available: an electronic display, a handheld digital camera, and a connection between the two. No special visual markers in the display content are needed, nor are fixed cameras pointing at the display. We evaluated the performance of Direct Pointer as an interaction product, showing that it performs as well as comparable techniques that require more sophisticated equipment.