Gaze gesture recognition with hierarchical temporal memory networks

  • Authors:
  • David Rozado;Francisco B. Rodriguez;Pablo Varona

  • Affiliations:
  • Grupo de Neurocomputación Biológica, Dpto. de Ingeniería Informática, EPS, Universidad Autónoma de Madrid, Madrid, Spain;Grupo de Neurocomputación Biológica, Dpto. de Ingeniería Informática, EPS, Universidad Autónoma de Madrid, Madrid, Spain;Grupo de Neurocomputación Biológica, Dpto. de Ingeniería Informática, EPS, Universidad Autónoma de Madrid, Madrid, Spain

  • Venue:
  • IWANN'11 Proceedings of the 11th international conference on Artificial neural networks conference on Advances in computational intelligence - Volume Part I
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Eye movements can be consciously controlled by humans to the extent of performing sequences of predefined movement patterns, or 'gaze gestures'. Gaze gestures can be tracked non-invasively employing a video-based eye tracking system. Gaze gestures hold great potential in the context of Human Computer Interaction as low-cost gaze trackers become more ubiquitous. In this work, we build an original set of 50 gaze gestures and evaluate the recognition performance of a Bayesian inference algorithm known as Hierarchical Temporal Memory, HTM. HTM uses a neocortically inspired hierarchical architecture and spatio-temporal coding to perform inference on multi-dimensional time series. Here, we show how an appropiate temporal codification is critical for good inference results. Our results highlight the potential of gaze gestures for the fields of accessibility and interaction with smartphones, projected displays and desktop computers.