Modeling systems with internal state using evolino
GECCO '05 Proceedings of the 7th annual conference on Genetic and evolutionary computation
Simple deterministically constructed recurrent neural networks
IDEAL'10 Proceedings of the 11th international conference on Intelligent data engineering and automated learning
Architectural and Markovian factors of echo state networks
Neural Networks
Simple deterministically constructed cycle reservoirs with regular jumps
Neural Computation
Neural Networks
Design strategies for weight matrices of echo state networks
Neural Computation
| Hi-index | 0.00 |
A lot of attention is now being focused on connectionist models known under the name "reservoir computing". The most prominent example of these approaches is a recurrent neural network architecture called an echo state network (ESN). ESNs were successfully applied in several time series modeling tasks and according to the authors they performed exceptionally well. Multiple enhancements to standard ESN were proposed in the literature. In this paper we follow the opposite direction by suggesting several simplifications to the original ESN architecture. ESN reservoir features contractive dynamics resulting from its' initialization with small weights. Sometimes it serves just as a simple memory of inputs and provides only negligible "extra-value" over much simple methods. We experimentally support this claim and we show that many tasks modeled by ESNs can be handled with much simple approaches.