Minimax classifiers based on neural networks

  • Authors:
  • Rocío Alaiz-Rodríguez;Alicia Guerrero-Curieses;Jesús Cid-Sueiro

  • Affiliations:
  • Departamento de Ingeniería Eléctrica y Electrónica, Escuela de Ingenierías Industrial e Informática, Campus de Vegazana, Universidad de León, 24071 León, Spain;Departamento de Teoría de la Señal y Comunicaciones, EPS, Universidad Carlos III de Madrid, Avda. de la Universidad, 30, 28911 Leganés-Madrid, Spain;Departamento de Teoría de la Señal y Comunicaciones, EPS, Universidad Carlos III de Madrid, Avda. de la Universidad, 30, 28911 Leganés-Madrid, Spain

  • Venue:
  • Pattern Recognition
  • Year:
  • 2005

Quantified Score

Hi-index 0.01

Visualization

Abstract

The problem of designing a classifier when prior probabilities are not known or are not representative of the underlying data distribution is discussed in this paper. Traditional learning approaches based on the assumption that class priors are stationary lead to sub-optimal solutions if there is a mismatch between training and future (real) priors. To protect against this uncertainty, a minimax approach may be desirable. We address the problem of designing a neural-based minimax classifier and propose two different algorithms: a learning rate scaling algorithm and a gradient-based algorithm. Experimental results show that both succeed in finding the minimax solution and it is also pointed out the differences between common approaches to cope with this uncertainty in priors and the minimax classifier.