2008 Special Issue: Iterative principles of recognition in probabilistic neural networks

  • Authors:
  • Jiří Grim;Jan Hora

  • Affiliations:
  • Institute of Information Theory and Automation, Czech Academy of Sciences P.O. BOX 18, CZ-18208 Prague 8, Czech Republic and Faculty of Nuclear Science and Physical Engineering, Czech Technical Un ...;Institute of Information Theory and Automation, Czech Academy of Sciences P.O. BOX 18, CZ-18208 Prague 8, Czech Republic and Faculty of Nuclear Science and Physical Engineering, Czech Technical Un ...

  • Venue:
  • Neural Networks
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

When considering the probabilistic approach to neural networks in the framework of statistical pattern recognition we assume approximation of class-conditional probability distributions by finite mixtures of product components. The mixture components can be interpreted as probabilistic neurons in neurophysiological terms and, in this respect, the fixed probabilistic description contradicts the well known short-term dynamic properties of biological neurons. By introducing iterative schemes of recognition we show that some parameters of probabilistic neural networks can be ''released'' for the sake of dynamic processes without disturbing the statistically correct decision making. In particular, we can iteratively adapt the mixture component weights or modify the input pattern in order to facilitate correct recognition. Both procedures are shown to converge monotonically as a special case of the well known EM algorithm for estimating mixtures.