Towards standardization of metrics for evaluation of artificial visual attention

  • Authors:
  • M. Zaheer Aziz;Bärbel Mertsching

  • Affiliations:
  • GET LAB, Universität Paderborn, Paderborn, Germany;GET LAB, Universität Paderborn, Paderborn, Germany

  • Venue:
  • Proceedings of the 10th Performance Metrics for Intelligent Systems Workshop
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Standardized methods and metrics for evaluating progress of research is important in every field of science. Computational modeling of visual attention is an important area of research that aims towards machine vision according to the role model of nature. Standards for quantitative evaluation of research achievements in this field are still missing. This paper proposes some measurement methods and metrics that can be used as conventions for evaluation of artificial attention models. The proposed methodology also takes into account the needs of assessing attention under different visual behaviors and considers performance against increasing levels of visual complexity. The measurement methods for the quantities used in the evaluation metrics are designed to make autonomous machine-based evaluation feasible. Creating traces of performance by different attention models using the proposed metrics can provide an objective analysis of the state of the art in this field.