Parsing visual stimuli into temporal units through eye movements

  • Authors:
  • Carlo Robino;Sofia Crespi;Ottavia Silva;Claudio de'Sperati

  • Affiliations:
  • Easy s. r.l., Milano, Italy;Neuroradiology Unit & CERMAC --- Scientific Institute & Università& Universitàà Vita-Salute San Raffaele, via Olgettina, Milano, Italy and Pisa, Italy;Università Vita-Salute San Raffaele, Milano, Italy;Università Vita-Salute San Raffaele, Milano, Italy

  • Venue:
  • Proceedings of the Symposium on Eye Tracking Research and Applications
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Automatic segmentation of a video stream poses a serious challenge to multimedia research. Here we explore the idea that temporal segmentation might include the observers' watching style. We propose a way to parse a visual stimulus into temporally-defined units by exploiting the difference of exploratory eye movements between novice and expert observers. The difference was condensed into a single quantity, the quasi-instantaneous spatial extension of the regions fixated significantly longer by either group of observers, which we termed Visual Differential Attractor (VDA). As test-bed, we presented a videotaped billiard match to novice and professional players, and recorded their eye movements. We assessed whether VDA, in tracing over time the oculomotor difference between experts and novices, would mark the individual shots embedded in the movie. Indeed, VDA showed systematic modulations over time, with peaks and toughs occurring before and after the shots, respectively. The effect disappeared by analyzing separately the scanpath of novices and experts. This finding suggests that it is possible to parse a visual stimulus into behaviorally relevant temporal units by comparing the gaze of expert and naïf observers.