Training ANFIS as an identifier with intelligent hybrid stable learning algorithm based on particle swarm optimization and extended Kalman filter

Authors:
Mahdi Aliyari Shoorehdeli;Mohammad Teshnehlab;Ali Khaki Sedigh
Affiliations:
ISLAB, Faculty of Electrical Engineering, K. N. Toosi University of Technology, P.O. Box 16315-1355, Tehran, Iran;ISLAB, Faculty of Electrical Engineering, K. N. Toosi University of Technology, P.O. Box 16315-1355, Tehran, Iran;ISLAB, Faculty of Electrical Engineering, K. N. Toosi University of Technology, P.O. Box 16315-1355, Tehran, Iran
Venue:
Fuzzy Sets and Systems
Year:
2009

Citing 53
Cited 7

Training multilayer perceptrons with the extended Kalman algorithm

Advances in neural information processing systems 1
NN-driven fuzzy reasoning

International Journal of Approximate Reasoning
Successive identification of a fuzzy model and its applications to prediction of a complex system

Fuzzy Sets and Systems
Original Contribution: Optimal filtering algorithms for fast learning in feedforward neural networks

Neural Networks
Adaptive fuzzy systems and control: design and stability analysis

Adaptive fuzzy systems and control: design and stability analysis
Block-structured recurrent neural networks

Neural Networks
Stability analysis and stabilization of fuzzy state space models

Fuzzy Sets and Systems - Special issue on fuzzy control
Neuro-fuzzy and soft computing: a computational approach to learning and machine intelligence

Neuro-fuzzy and soft computing: a computational approach to learning and machine intelligence
On-line optimization of fuzzy systems

Information Sciences: an International Journal
Fuzzy Kalman filtering

Information Sciences: an International Journal
Extracting fuzzy rules for system modeling using a hybrid of genetic algorithms and Kalman filter

Fuzzy Sets and Systems
Identifying fuzzy models utilizing genetic programming

Fuzzy Sets and Systems
Particle swarm optimization method in multiobjective problems

Proceedings of the 2002 ACM symposium on Applied computing
Genetic Algorithms in Search, Optimization and Machine Learning

Genetic Algorithms in Search, Optimization and Machine Learning
Recurrent Neural Networks for Prediction: Learning Algorithms,Architectures and Stability

Recurrent Neural Networks for Prediction: Learning Algorithms,Architectures and Stability
Fuzzy Sets, Neural Networks and Soft Computing

Fuzzy Sets, Neural Networks and Soft Computing
Training fuzzy systems with the extended Kalman filter

Fuzzy Sets and Systems - Fuzzy systems
A new fuzzy neural network with fast learning algorithm and guaranteed stability for manufacturing process control

Fuzzy Sets and Systems - Fuzzy systems
The Behavior of Particles

EP '98 Proceedings of the 7th International Conference on Evolutionary Programming VII
A Constructive Algorithm for Fuzzy Neural Networks

ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97) -Volume 4 - Volume 4
Simple and conditioned adaptive behavior from Kalman filter trained recurrent networks

Neural Networks - 2003 Special issue: Advances in neural networks research — IJCNN'03
An optimized Takagi-Sugeno type neuro-fuzzy system for modeling robot manipulators

Neural Computing and Applications
Multiobjective optimization using dynamic neighborhood particle swarm optimization

CEC '02 Proceedings of the Evolutionary Computation on 2002. CEC '02. Proceedings of the 2002 Congress - Volume 02
EPSO - best-of-two-worlds meta-heuristic applied to power system problems

CEC '02 Proceedings of the Evolutionary Computation on 2002. CEC '02. Proceedings of the 2002 Congress - Volume 02
Recurrent fuzzy network design using hybrid evolutionary learning algorithms

Neurocomputing
A learning algorithm for continually running fully recurrent neural networks

Neural Computation
Identification using ANFIS with intelligent hybrid stable learning algorithm approaches

Neural Computing and Applications
Sequential Adaptive Fuzzy Inference System (SAFIS) for nonlinear system identification and prediction

Fuzzy Sets and Systems
A real-time learning algorithm for a multilayered neural networkbased on the extended Kalman filter

IEEE Transactions on Signal Processing
The fully informed particle swarm: simpler, maybe better

IEEE Transactions on Evolutionary Computation
Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients

IEEE Transactions on Evolutionary Computation
Handling multiple objectives with particle swarm optimization

IEEE Transactions on Evolutionary Computation
Learning to play games using a PSO-based competitive learning approach

IEEE Transactions on Evolutionary Computation
An approach to multimodal biomedical image registration utilizing particle swarm optimization

IEEE Transactions on Evolutionary Computation
Stability analysis of the particle dynamics in particle swarm optimizer

IEEE Transactions on Evolutionary Computation
A new method for constructing membership functions and fuzzy rulesfrom training examples

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
A recurrent fuzzy-neural model for dynamic system identification

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Prediction and identification using wavelet-based recurrent fuzzy neural networks

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
TSK fuzzy systems types II and III stability analysis: continuous case

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Implementation of evolutionary fuzzy systems

IEEE Transactions on Fuzzy Systems
Identification and control of dynamic systems using recurrent fuzzy neural networks

IEEE Transactions on Fuzzy Systems
A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms

IEEE Transactions on Fuzzy Systems
Fuzzy identification using fuzzy neural networks with stable learning algorithms

IEEE Transactions on Fuzzy Systems
Stability Analysis of Discrete TSK Type II/III Systems

IEEE Transactions on Fuzzy Systems
Design for Self-Organizing Fuzzy Neural Networks Based on Genetic Algorithms

IEEE Transactions on Fuzzy Systems
Automatic Design of Hierarchical Takagi–Sugeno Type Fuzzy Systems Using Evolutionary Algorithms

IEEE Transactions on Fuzzy Systems
Fuzzy logic for digital phase-locked loop filter design

IEEE Transactions on Fuzzy Systems
Recurrent neuro-fuzzy networks for nonlinear process modeling

IEEE Transactions on Neural Networks
A recurrent self-organizing neural fuzzy inference network

IEEE Transactions on Neural Networks
Identification and control of dynamical systems using neural networks

IEEE Transactions on Neural Networks
Learning and convergence analysis of neural-type structured networks

IEEE Transactions on Neural Networks
Neurocontrol of nonlinear dynamical systems with Kalman filter trained recurrent networks

IEEE Transactions on Neural Networks
Gradient calculations for dynamic recurrent neural networks: a survey

IEEE Transactions on Neural Networks

An integrated method for the construction of compact fuzzy neural models

ICIC'10 Proceedings of the 6th international conference on Advanced intelligent computing theories and applications: intelligent computing
Automatic rule tuning of a fuzzy logic controller using particle swarm optimisation

AICI'10 Proceedings of the 2010 international conference on Artificial intelligence and computational intelligence: Part II
In-vehicle network level fault diagnostics using fuzzy inference systems

Applied Soft Computing
Variances Handling Method of Clinical Pathways Based on T-S Fuzzy Neural Networks with Novel Hybrid Learning Algorithm

Journal of Medical Systems
GBF Trained Neuro-fuzzy Equalizer for Time Varying Channels

International Journal of Applied Evolutionary Computation
Intelligent ensemble T-S fuzzy neural networks with RCDPSO_DM optimization for effective handling of complex clinical pathway variances

Computers in Biology and Medicine
An enhanced discriminability recurrent fuzzy neural network for temporal classification problems

Fuzzy Sets and Systems

Quantified Score

Hi-index	0.20

Visualization

Abstract

This paper proposes a novel hybrid learning algorithm with stable learning laws for Adaptive Network-based Fuzzy Inference System (ANFIS) as a system identifier. The proposed hybrid learning algorithm is based on the particle swarm optimization (PSO) for training the antecedent part and the extended Kalman filter (EKF) for training the conclusion part. Lyapunov stability theory is used to study the stability of the proposed algorithm. Comparison results of the proposed approach, PSO algorithm for training the antecedent part and recursive least squares (RLSs) or EKF algorithm for training the conclusion part, with the other classical approaches such as, gradient descent, resilient propagation, quick propagation, Levenberg-Marquardt for training the antecedent part and RLSs algorithm for training the conclusion part are provided. Moreover, it is shown that applying PSO, a powerful optimizer, to optimally train the parameters of the membership function on the antecedent part of the fuzzy rules in ANFIS system is a stable approach which results in an identifier with the best trained model. Stability constraints are obtained and different simulation results are given to validate the results. Also, the stability of Levenberg-Marquardt algorithms for ANFIS training is analyzed.