Modeling the influences of cyclic top-down and bottom-up processes for reinforcement learning in eye movements

Authors:
Ji Hyoun Lim;Yili Liu
Affiliations:
Design Team, Mobile Communication Division, Samsung Electronics, Seoul, Korea;Department of Industrial and Operations Engineering, University of Michigan, Ann Arbor, MI
Venue:
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
Year:
2009

Citing 8
Cited 0

Statistical dependency in visual scanning

Human Factors
Attention and control: have we been asking the wrong questions? A critical review of twenty-five years

Attention and performance XIV (silver jubilee volume)
A Model of Saliency-Based Visual Attention for Rapid Scene Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Color-based retrieval

Principles of visual information retrieval
Introduction to Reinforcement Learning

Introduction to Reinforcement Learning
A Study on Acquiring Underlying Behavioral Criteria for Manipulator Motion by Focusing on Learning Efficiency

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
Imitation of Human-Eye Motion—How to Fix Gaze of an Active Vision System

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
Memory-Based Human Motion Simulation for Computer-Aided Ergonomic Design

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans

Quantified Score

Hi-index	0.00

Visualization

Abstract

Understanding and reproducing complex human oculomotor behaviors using computational models is a challenging task. In this paper, two studies are presented, which focus on the development and evaluation of a computational model to show the influences of cyclic top-down and bottom-up processes on eye movements. To explain these processes, reinforcement learning was used to control eye movements. The first study showed that, in a picture-viewing task, different policies obtained from different picture-viewing conditions produced different types of eye movement patterns. In another visual search task, the second study illustrated that feedback information from each saccadic eye movement could be used to update the model's eye movement policy, generating different patterns in the following saccade. These two studies demonstrate the value of an integrated reinforcement learning model in explaining both top-down and bottom-up processes of eye movements within one computational model.