Eye gaze assisted human-computer interaction in a hand gesture controlled multi-display environment

  • Authors:
  • Tong Cha;Sebastian Maier

  • Affiliations:
  • Fraunhofer Institute of Optronics System, Technologies and Image Exploitation IOSB, Karlsruhe, Germany;Fraunhofer Institute of Optronics System, Technologies and Image Exploitation IOSB, Karlsruhe, Germany

  • Venue:
  • Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

A special human-computer interaction (HCI) framework processing user input in a multi-display environment has the ability to detect and interpret dynamic hand gesture input. In an environment equipped with large displays, full contactless application control is possible with this system. This framework was extended with a new input modality that involves human gaze in the interaction. The main contribution of this work is the possibility to unite any types of computer input and obtain a detailed view on the behaviour of every modality. Information is then available in the form of high speed data samples received in real time. The framework is designed with a special regard to gaze and hand gesture input modality in multi-display environments with large-area screens.