When camera meets accelerometer: a novel way for 3d interaction of mobile phone

  • Authors:

  • Mingming Fan;Donald Patterson;Yuanchun Shi

  • Affiliations:

  • University of California, Irvine, Irvine, California, United States;University of California, Irvine, Irvine, California, United States;Tsinghua University, Beijing, China

  • Venue:
  • MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Performing real-time 3D motion interaction with a mobile phone is useful for extending interaction out of a limited screen. However, current phone motion detection approaches, which use only camera or accelerometer, have limitations in recognizing versatile 3D motions simultaneously. In this paper we present a real-time approach designed for 3D tasks by holding and moving a phone equipped with both a camera and an accelerometer. By analyzing both motion features from image frames and changes of accelerometer data simultaneously, our approach can naturally distinguish translation and rotation of a mobile phone. In a pilot user study, we demonstrated our design requires low learning effort and has high accuracy. Since it does not require any outside infrastructure, our approach can be applied to any phone with a camera and an accelerometer. Our main contribution is giving mobile phone users 3D interaction ability by exploiting hand translation and rotation.