Controlling the parallel layer perceptron complexity using a multiobjective learning algorithm

  • Authors:
  • D. A. G. Vieira;J. A. Vasconcelos;W. M. Caminhas

  • Affiliations:
  • Federal University of Minas Gerias, Department of Electrical Engineering, CEP 30.270-010, Campus da UFMG (Pampulha), Belo Horizonte, MG, Brazil;Federal University of Minas Gerias, Department of Electrical Engineering, CEP 30.270-010, Campus da UFMG (Pampulha), Belo Horizonte, MG, Brazil;Federal University of Minas Gerias, Department of Electrical Engineering, CEP 30.270-010, Campus da UFMG (Pampulha), Belo Horizonte, MG, Brazil

  • Venue:
  • Neural Computing and Applications
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper deals with the parallel layer perceptron (PLP) complexity control, bias and variance dilemma, using a multiobjective (MOBJ) training algorithm. To control the bias and variance the training process is rewritten as a bi-objective problem, considering the minimization of both training error and norm of the weight vector, which is a measure of the network complexity. This method is applied to regression and classification problems and compared with several other training procedures and topologies. The results show that the PLP MOBJ training algorithm presents good generalization results, outperforming traditional methods in the tested examples.