Identification using ANFIS with intelligent hybrid stable learning algorithm approaches and stability analysis of training methods

Authors:
Mahdi Aliyari Shoorehdeli;Mohammad Teshnehlab;Ali Khaki Sedigh;M. Ahmadieh Khanesar
Affiliations:
K. N. Toosi University of Technology, Seyyed Khandan Bridge, Tehran, Iran;K. N. Toosi University of Technology, Seyyed Khandan Bridge, Tehran, Iran;K. N. Toosi University of Technology, Seyyed Khandan Bridge, Tehran, Iran;K. N. Toosi University of Technology, Seyyed Khandan Bridge, Tehran, Iran
Venue:
Applied Soft Computing
Year:
2009

Citing 31
Cited 5

NN-driven fuzzy reasoning

International Journal of Approximate Reasoning
Convergence and exponential convergence of identification algorithms with directional forgetting factor

Automatica (Journal of IFAC)
Block-structured recurrent neural networks

Neural Networks
Stability analysis and stabilization of fuzzy state space models

Fuzzy Sets and Systems - Special issue on fuzzy control
Particle swarm optimization method in multiobjective problems

Proceedings of the 2002 ACM symposium on Applied computing
Genetic Algorithms in Search, Optimization and Machine Learning

Genetic Algorithms in Search, Optimization and Machine Learning
Recurrent Neural Networks for Prediction: Learning Algorithms,Architectures and Stability

Recurrent Neural Networks for Prediction: Learning Algorithms,Architectures and Stability
Fuzzy Sets, Neural Networks and Soft Computing

Fuzzy Sets, Neural Networks and Soft Computing
A new fuzzy neural network with fast learning algorithm and guaranteed stability for manufacturing process control

Fuzzy Sets and Systems - Fuzzy systems
The Behavior of Particles

EP '98 Proceedings of the 7th International Conference on Evolutionary Programming VII
An optimized Takagi-Sugeno type neuro-fuzzy system for modeling robot manipulators

Neural Computing and Applications
Multiobjective optimization using dynamic neighborhood particle swarm optimization

CEC '02 Proceedings of the Evolutionary Computation on 2002. CEC '02. Proceedings of the 2002 Congress - Volume 02
Recurrent fuzzy network design using hybrid evolutionary learning algorithms

Neurocomputing
A learning algorithm for continually running fully recurrent neural networks

Neural Computation
The fully informed particle swarm: simpler, maybe better

IEEE Transactions on Evolutionary Computation
Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients

IEEE Transactions on Evolutionary Computation
Handling multiple objectives with particle swarm optimization

IEEE Transactions on Evolutionary Computation
Learning to play games using a PSO-based competitive learning approach

IEEE Transactions on Evolutionary Computation
An approach to multimodal biomedical image registration utilizing particle swarm optimization

IEEE Transactions on Evolutionary Computation
Stability analysis of the particle dynamics in particle swarm optimizer

IEEE Transactions on Evolutionary Computation
A recurrent fuzzy-neural model for dynamic system identification

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Prediction and identification using wavelet-based recurrent fuzzy neural networks

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Identification and control of dynamic systems using recurrent fuzzy neural networks

IEEE Transactions on Fuzzy Systems
A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms

IEEE Transactions on Fuzzy Systems
Fuzzy identification using fuzzy neural networks with stable learning algorithms

IEEE Transactions on Fuzzy Systems
Brief paper: Implementation of self-tuning regulators with variable forgetting factors

Automatica (Journal of IFAC)
Recurrent neuro-fuzzy networks for nonlinear process modeling

IEEE Transactions on Neural Networks
A recurrent self-organizing neural fuzzy inference network

IEEE Transactions on Neural Networks
Identification and control of dynamical systems using neural networks

IEEE Transactions on Neural Networks
Learning and convergence analysis of neural-type structured networks

IEEE Transactions on Neural Networks
Gradient calculations for dynamic recurrent neural networks: a survey

IEEE Transactions on Neural Networks

Stability analysis and robustness design of nonlinear systems: An NN-based approach

Applied Soft Computing
Review: Adaptive cruise control look-ahead system for energy management of vehicles

Expert Systems with Applications: An International Journal
Enhanced combination modeling method for combustion efficiency in coal-fired boilers

Applied Soft Computing
Bio-Inspired Techniques for Resources State Prediction in Large Scale Distributed Systems

International Journal of Distributed Systems and Technologies
A hybrid intelligent system of ANFIS and CAPM for stock portfolio optimization

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper proposes a novel hybrid learning algorithm with stable learning laws for Adaptive Network based Fuzzy Inference System (ANFIS) as a system identifier and studies the stability of this algorithm. The new hybrid learning algorithm is based on particle swarm optimization (PSO) for training the antecedent part and forgetting factor recursive least square (FFRLS) for training the conclusion part. Two famous training algorithms for ANFIS are the gradient descent (GD) to update antecedent part parameters and using GD or recursive least square (RLS) to update conclusion part parameters. Lyapunov stability theory is used to study the stability of the proposed algorithms. This paper, also studies the stability of PSO as an optimizer in training the identifier. Stable learning algorithms for the antecedent and consequent parts of fuzzy rules are proposed. Some constraints are obtained and simulation results are given to validate the results. It is shown that instability will not occur for the leaning rate and PSO factors in the presence of constraints. The learning rate can be calculated on-line and will provide an adaptive learning rate for the ANFIS structure. This new learning scheme employs adaptive learning rate that is determined by input-output data. Also, stable learning algorithms for two common methods are proposed based on Lyapunov stability theory and some constraints are obtained.