AutoSelect: What You Want Is What You Get: Real-Time Processing of Visual Attention and Affect

  • Authors:

  • Nikolaus Bee;Helmut Prendinger;Arturo Nakasone;Elisabeth André;Mitsuru Ishizuka

  • Affiliations:

  • Institute of Computer Science, University of Augsburg, Augsburg, Germany;National Institute of Informatics, Tokyo, Japan;Graduate School of Information Science and Technology, University of Tokyo, Tokyo, Japan;Institute of Computer Science, University of Augsburg, Augsburg, Germany;Graduate School of Information Science and Technology, University of Tokyo, Tokyo, Japan

  • Venue:
  • PIT'06 Proceedings of the 2006 international tutorial and research conference on Perception and Interactive Technologies
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

While objects of our focus of attention (“where we are looking at”) and accompanying affective responses to those objects is part of our daily experience, little research exists on investigating the relation between attention and positive affective evaluation. The purpose of our research is to process users' emotion and attention in real-time, with the goal of designing systems that may recognize a user's affective response to a particular visually presented stimulus in the presence of other stimuli, and respond accordingly. In this paper, we introduce the AutoSelect system that automatically detects a user's preference based on eye movement data and physiological signals in a two-alternative forced choice task. In an exploratory study involving the selection of neckties, the system could correctly classify subjects' choice of in 81%. In this instance of AutoSelect, the gaze ‘cascade effect' played a dominant role, whereas pupil size could not be shown as a reliable predictor of preference.