Mobile magic hand: camera phone based interaction using visual code and optical flow

Authors:
Yuichi Yoshida;Kento Miyaoku;Takashi Satou
Affiliations:
Nippon Telegraph and Telephone Corporation, NTT Cyber Communications Laboratory, Yokosuka, Kanagawa, Japan;Nippon Telegraph and Telephone Corporation, NTT Cyber Communications Laboratory, Yokosuka, Kanagawa, Japan;Nippon Telegraph and Telephone Corporation, NTT Cyber Communications Laboratory, Yokosuka, Kanagawa, Japan
Venue:
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction platforms and techniques
Year:
2007

Citing 7
Cited 0

The world through the computer: computer augmented interaction with real world environments

Proceedings of the 8th annual ACM symposium on User interface and software technology
Real-world interaction using the FieldMouse

Proceedings of the 12th annual ACM symposium on User interface software and technology
TiltText: using tilt for text input to mobile phones

Proceedings of the 16th annual ACM symposium on User interface software and technology
TinyMotion: camera phone based interaction methods

CHI '06 Extended Abstracts on Human Factors in Computing Systems
An iterative image registration technique with an application to stereo vision

IJCAI'81 Proceedings of the 7th international joint conference on Artificial intelligence - Volume 2
Mobile reacher interface for intuitive information navigation

INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction
A conceptual framework for camera phone-based interaction techniques

PERVASIVE'05 Proceedings of the Third international conference on Pervasive Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

We propose the "Mobile Magic Hand" interface; it is an extension of our previous visual code-based interface system. Once the user acquires the visual code of interest, the user can then manipulate the related virtual object/system without having to keep the camera centered on the visual code. Our new interface does this analyzing the optical flow as captured by the camera. For example, consider a visual code that represents a 3D object, such as a dial. After selecting the code, the user can freely rotate and/or move the virtual object without having to keep the camera pointed at the code. This interface is much more user friendly and is more intuitive since the user's hand gestures can be more relaxed, more natural, and more extensive. In this paper, we describe "Mobile Magic Hand", some applications, and a preliminary user study of a prototype system.