Adaptive classification of temporal signals in fixed-weight recurrent neural networks: An existence proof

  • Authors:
  • Ivan Y. Tyukin;Danil Prokhorov;Cees van Leeuwen

  • Affiliations:
  • Department of Mathematics, School of Mathematics and Computer Science, University of Leicester, Leicester, LE1 7RH, U.K., and Laboratory for Perceptual Dynamics, Brain Science Institute, RIKEN, Wa ...;Toyota Technical Center, Ann Arbor, MI 48105, U.S.A. dvprokhorov@gmail.com;Laboratory for Perceptual Dynamics, Brain Science Institute, RIKEN, Wako-shi, Saitama, 351-0198, Japan. ceesvl@brain.riken.jp

  • Venue:
  • Neural Computation
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recurrent neural networks with fixed weights have been shown in practice to successfully classify adaptively signals that vary as a function of time in the presence of additive noise and parametric perturbations. We address the question: Can this ability be explained theoretically? We provide a mathematical proof that these networks have this ability even when parametric perturbations enter the signals nonlinearly. The restrictions that we impose on the signals to be classified are that they satisfy an assumption of nondegeneracy and that noise amplitude is sufficiently small. Further, we demonstrate that the recurrent neural networks may not only classify uncertain signals adaptively but also can recover the values of uncertain parameters of the signals, up to their equivalence classes.