2007 Special Issue: Decoupled echo state networks with lateral inhibition

Authors:
Yanbo Xue;Le Yang;Simon Haykin
Affiliations:
Electrical and Computer Engineering Department, McMaster University, Hamilton, Ontario, L8S 4K1, Canada;Electrical and Computer Engineering Department, McMaster University, Hamilton, Ontario, L8S 4K1, Canada;Electrical and Computer Engineering Department, McMaster University, Hamilton, Ontario, L8S 4K1, Canada
Venue:
Neural Networks
Year:
2007

Citing 5
Cited 21

Intelligence: the eye, the brain, and the computer

Intelligence: the eye, the brain, and the computer
Principal component neural networks: theory and applications

Principal component neural networks: theory and applications
Real-time computing without stable states: a new framework for neural computation based on perturbations

Neural Computation
Modeling systems with internal state using evolino

GECCO '05 Proceedings of the 7th annual conference on Genetic and evolutionary computation
Neural Networks: A Comprehensive Foundation (3rd Edition)

Neural Networks: A Comprehensive Foundation (3rd Edition)

Recurrent neural network based BER prediction for NLOS channels

Mobility '07 Proceedings of the 4th international conference on mobile technology, applications, and systems and the 1st international symposium on Computer human interaction in mobile technology
Predictive Modeling with Echo State Networks

ICANN '08 Proceedings of the 18th international conference on Artificial Neural Networks, Part I
MULTI-LAYER CORRECTIVE CASCADE ARCHITECTURE FOR ON-LINE PREDICTIVE ECHO STATE NETWORKS

Applied Artificial Intelligence
Pruning and regularization in reservoir computing

Neurocomputing
Recurrent neural network based bit error rate prediction for narrowband fading channel

CSN '07 Proceedings of the Sixth IASTED International Conference on Communication Systems and Networks
Effects of connectivity structure of complex echo state network on its prediction performance for nonlinear time series

Neurocomputing
Simple deterministically constructed recurrent neural networks

IDEAL'10 Proceedings of the 11th international conference on Intelligent data engineering and automated learning
Architectural and Markovian factors of echo state networks

Neural Networks
Research on design method of small world property ESN

ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part I
Anti boundary effect wavelet decomposition echo state networks

ISNN'11 Proceedings of the 8th international conference on Advances in neural networks - Volume Part I
Prediction for noisy nonlinear time series by echo state network based on dual estimation

Neurocomputing
Data-driven based model for flow prediction of steam system in steel industry

Information Sciences: an International Journal
Recurrent sparse support vector regression machines trained by active learning in the time-domain

Expert Systems with Applications: An International Journal
Simple deterministically constructed cycle reservoirs with regular jumps

Neural Computation
Survey: Reservoir computing approaches to recurrent neural network training

Computer Science Review
Balanced echo state networks

Neural Networks
Reservoir sizes and feedback weights interact non-linearly in echo state networks

ICANN'12 Proceedings of the 22nd international conference on Artificial Neural Networks and Machine Learning - Volume Part I
Optimization of self-organizing polynomial neural networks

Expert Systems with Applications: An International Journal
The effect of lateral inhibitory connections in spatial architecture neural network

ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part I
Modular state space of echo state network

Neurocomputing
Initializing reservoirs with exhibitory and inhibitory signals using unsupervised learning techniques

Proceedings of the Fourth Symposium on Information and Communication Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Building on some prior work, in this paper we describe a novel structure termed the decoupled echo state network (DESN) involving the use of lateral inhibition. Two low-complexity implementation schemes, namely, the DESN with reservoir prediction (DESN + RP) and DESN with maximum available information (DESN + MaxInfo), are developed: (1) In the multiple superimposed oscillator (MSO) problem, DESN + MaxInfo exhibits three important attributes: lower generalization mean-square error (MSE), better robustness with respect to the random generation of reservoir weight matrix and feedback connections, and robustness to variations in the sparseness of reservoir weight matrix, compared to DESN + RP. (2) For a noiseless nonlinear prediction task, DESN + RP outperforms the DESN + MaxInfo and single reservoir-based ESN approach in terms of lower prediction MSE and better robustness to a change in the number of inputs and sparsity of the reservoir weight matrix. Finally, in a real-life prediction task using noisy sea clutter data, both schemes exhibit higher prediction accuracy and successful design ratio than a conventional ESN with a single reservoir.