Convergence of gradient method with momentum for two-Layer feedforward neural networks

Authors:
Naimin Zhang;Wei Wu;Gaofeng Zheng
Affiliations:
Math. & Inf. Sci. Coll., Wenzhou Univ., China;-;-
Venue:
IEEE Transactions on Neural Networks
Year:
2006

Citing 0
Cited 11

An Improved Fuzzy Neural Network for Ultrasonic Motors Control

ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks
When does online BP training converge?

IEEE Transactions on Neural Networks
Soft sensor modeling of AlCl3•6H2O content based on powell-BP

CAR'10 Proceedings of the 2nd international Asia conference on Informatics in control, automation and robotics - Volume 2
Convergence analysis of a back-propagation algorithm with adaptive momentum

Neurocomputing
Boundedness and convergence of online gradient method with penalty and momentum

Neurocomputing
Review article: A self-organizing map-based initialization for hybrid training of feedforward neural networks

Applied Soft Computing
Convergence of an online gradient method with inner-product penalty and adaptive momentum

Neurocomputing
Convergence of a Batch Gradient Algorithm with Adaptive Momentum for Neural Networks

Neural Processing Letters
Deterministic convergence of an online gradient method with momentum

ICIC'06 Proceedings of the 2006 international conference on Intelligent Computing - Volume Part I
Letters: A new adaptive momentum algorithm for split-complex recurrent neural networks

Neurocomputing
Computational properties of cyclic and almost-cyclic learning with momentum for feedforward neural networks

ISNN'12 Proceedings of the 9th international conference on Advances in Neural Networks - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

A gradient method with momentum for two-layer feedforward neural networks is considered. The learning rate is set to be a constant and the momentum factor an adaptive variable. Both the weak and strong convergence results are proved, as well as the convergence rates for the error function and for the weight. Compared to the existing convergence results, our results are more general since we do not require the error function to be quadratic.