Gating echo state neural networks for time series forecasting

Authors:
Štefan Babinec;Jiří Pospíchal
Affiliations:
Department of Mathematics, Fac. of Chemical and Food Technologies, Slovak University of Technology, Bratislava, Slovakia;Institute of Applied Informatics, Fac. of Informatics and Information Technologies, Slovak University of Technology, Bratislava, Slovakia
Venue:
ICONIP'08 Proceedings of the 15th international conference on Advances in neuro-information processing - Volume Part I
Year:
2008

Citing 5
Cited 0

Hierarchical mixtures of experts and the EM algorithm

Neural Computation
Neural Networks: A Comprehensive Foundation

Neural Networks: A Comprehensive Foundation
Adaptive mixtures of local experts

Neural Computation
Improving the prediction accuracy of echo state neural networks by Anti-Oja's learning

ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
Mixtures-of-experts of autoregressive time series: asymptotic normality and model specification

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

"Echo State" neural networks, which are a special case of recurrent neural networks, are studied from the viewpoint of their learning ability, with a goal to achieve their greater predictive ability. In this paper we study the influence of the memory length on predictive abilities of Echo State neural networks. The conclusion is that Echo State neural networks with fixed memory length can have troubles with adaptation of its intrinsic dynamics to dynamics of the prediction task. Therefore, we have tried to create complex prediction system as a combination of the local expert Echo State neural networks with different memory length and one special gating Echo State neural network. This approach was tested in laser fluctuations prediction. The prediction error achieved by this approach was substantially smaller in comparison with prediction error achieved by standard Echo State neural networks.