PointPose demo: using a depth camera for finger pose estimation on touch-based mobile devices

  • Authors:
  • Sven Kratz;Patrick Chiu;Maribeth Back

  • Affiliations:
  • FX Palo Alto Laboratory, Palo Alto, CA, USA;FX Palo Alto Laboratory, Palo Alto, CA, USA;FX Palo Alto Laboratory, Palo Alto, CA, USA

  • Venue:
  • Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present PointPose, a prototype that allows finger pose information (tilt and rotation) to be obtained at the point of touch on touch-based mobile device, thus adding to the expressiveness of touch input. PointPose uses a short-range depth sensor viewing the touch screen that provides a point cloud that is used to infer finger pose information. Our prototype is lightweight, does not require any additional tracking, and can be adapted to work with most touch-based mobile devices, making it ideal for prototyping touch-based applications that make use of finger pose information.