Gaze-contingent temporal filtering of video

  • Authors:
  • Martin Böhme;Michael Dorr;Thomas Martinetz;Erhardt Barth

  • Affiliations:
  • University of Lübeck, Germany;University of Lübeck, Germany;University of Lübeck, Germany;University of Lübeck, Germany

  • Venue:
  • Proceedings of the 2006 symposium on Eye tracking research & applications
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We describe an algorithm for manipulating the temporal resolution of a video in real time, contingent upon the viewer's direction of gaze. The purpose of this work is to study the effect that a controlled manipulation of the temporal frequency content in real-world scenes has on eye movements. We build on the work of Perry and Geisler [1998; 2002], who manipulate spatial resolution as a function of gaze direction, allowing them to mimic the resolution distribution of the human retina or to simulate the effect of various diseases (e.g. glaucoma).Our temporal filtering algorithm is similar to that of Perry and Geisler in that we interpolate between the levels of a multiresolution pyramid. However, in our case, the pyramid is built along the temporal dimension, and this requires careful management of the buffering of video frames and of the order in which the filtering operations are performed. On a standard personal computer, the algorithm achieves real-time performance (30 frames per second) on high-resolution videos (960 by 540 pixels).We present experimental results showing that the manipulation performed by the algorithm reduces the number of high-amplitude saccades and can remain unnoticed by the observer.