Detecting and leveraging finger orientation for interaction with direct-touch surfaces

  • Authors:

  • Feng Wang;Xiang Cao;Xiangshi Ren;Pourang Irani

  • Affiliations:

  • Kochi University of Technology, Kochi, Japan;Microsoft Research Cambridge, Cambridge, United Kingdom;Kochi University of Technology, Kochi, Japan;University of Manitoba, Manitoba, Canada

  • Venue:
  • Proceedings of the 22nd annual ACM symposium on User interface software and technology
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Current interactions on direct-touch interactive surfaces are often modeled based on properties of the input channel that are common in traditional graphical user interfaces (GUI) such as x-y coordinate information. Leveraging additional information available on the surfaces could potentially result in richer and novel interactions. In this paper we specifically explore the role of finger orientation. This property is typically ignored in touch-based interactions partly because of the ambiguity in determining it solely from the contact shape. We present a simple algorithm that unambiguously detects the directed finger orientation vector in real-time from contact information only, by considering the dynamics of the finger landing process. Results of an experimental evaluation show that our algorithm is stable and accurate. We then demonstrate how finger orientation can be leveraged to enable novel interactions and to infer higher-level information such as hand occlusion or user position. We present a set of orientation-aware interaction techniques and widgets for direct-touch surfaces.