Critical echo state networks

Authors:
Márton Albert Hajnal;András Lőrincz
Affiliations:
Eötvös Loránd University, Budapest, Hungary;Eötvös Loránd University, Budapest, Hungary
Venue:
ICANN'06 Proceedings of the 16th international conference on Artificial Neural Networks - Volume Part I
Year:
2006

Citing 1
Cited 3

Real-time computing without stable states: a new framework for neural computation based on perturbations

Neural Computation

Effects of connectivity structure of complex echo state network on its prediction performance for nonlinear time series

Neurocomputing
Improving recurrent neural network performance using transfer entropy

ICONIP'10 Proceedings of the 17th international conference on Neural information processing: models and applications - Volume Part II
Architectural and Markovian factors of echo state networks

Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

We are interested in the optimization of the recurrent connection structure of Echo State Networks (ESNs), because their topology can strongly influence performance. We study ESN predictive capacity by numerical simulations on Mackey-Glass time series, and find that a particular small subset of ESNs is much better than ordinary ESNs provided that the topology of the recurrent feedback connections satisfies certain conditions. We argue that the small subset separates two large sets of ESNs and this separation can be characterized in terms of phase transitions. With regard to the criticality of this phase transition, we introduce the notion of Critical Echo State Networks (CESN). We discuss why CESNs perform better than other ESNs.