Gradient descent learning algorithm overview: a general dynamical systems perspective

Authors:
P. Baldi
Affiliations:
Div. of Biol., California Inst. of Technol., Pasadena, CA
Venue:
IEEE Transactions on Neural Networks
Year:
1995

Citing 0
Cited 13

Sufficient conditions for error backflow convergence in dynamical recurrent neural networks

Neural Computation
Computational intelligence based approach for the joint trajectory generation of cooperative robotic systems

Systems Analysis Modelling Simulation
Time-Scaling in Recurrent Neural Learning

ICANN '02 Proceedings of the International Conference on Artificial Neural Networks
Genetic Programming Discovers Efficient Learning Rules for the Hidden and Output Layers of Freeforward Neural Networks

Proceedings of the Second European Workshop on Genetic Programming
Accelerated Backpropagation Learning: Extended Dynamic Parallel Tangent Optimization Algorithm

AI '00 Proceedings of the 13th Biennial Conference of the Canadian Society on Computational Studies of Intelligence: Advances in Artificial Intelligence
On unique representations of certain dynamical systems produced by continuous-time recurrent neural networks

Neural Computation
Discovering efficient learning rules for feedforward neural networks using genetic programming

Recent advances in intelligent paradigms and applications
A Genetic Algorithm-Based Artificial Neural Network Approach for Parameter Selection in the Production of Tailor-Welded Blanks

ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks, Part III
Back propagation with randomized cost function for training neural networks

RSFDGrC'03 Proceedings of the 9th international conference on Rough sets, fuzzy sets, data mining, and granular computing
Discriminative structure selection method of Gaussian Mixture Models with its application to handwritten digit recognition

Neurocomputing
Genetic algorithms for feature selection of image analysis-based quality monitoring model: An application to an iron mine

Engineering Applications of Artificial Intelligence
Biologically-inspired visual-motor coordination model in a navigation problem

KES'06 Proceedings of the 10th international conference on Knowledge-Based Intelligent Information and Engineering Systems - Volume Part III
Self-Organizing Hidden Markov Model Map (SOHMMM)

Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

Gives a unified treatment of gradient descent learning algorithms for neural networks using a general framework of dynamical systems. This general approach organizes and simplifies all the known algorithms and results which have been originally derived for different problems (fixed point/trajectory learning), for different models (discrete/continuous), for different architectures (forward/recurrent), and using different techniques (backpropagation, variational calculus, adjoint methods, etc.). The general approach can also be applied to derive new algorithms. The author then briefly examines some of the complexity issues and limitations intrinsic to gradient descent learning. Throughout the paper, the author focuses on the problem of trajectory learning