A constrained approximation algorithm by encoding second-order derivative information into feedforward neural networks

Authors:
Qing-Hua Ling;Fei Han
Affiliations:
School of Computer Science and Engineering, Jiangsu University of Science and Technology, Zhenjiang, Jiangsu, China;School of Computer Science and Telecommunication Engineering, Jiangsu University, Zhenjiang, Jiangsu, China
Venue:
ICIC'09 Proceedings of the Intelligent computing 5th international conference on Emerging intelligent computing technology and applications
Year:
2009

Citing 8
Cited 0

What size net gives valid generalization?

Neural Computation
Merging back-propagation and Hebbian learning rules for robust classifications

Neural Networks
A neural root finder of polynomials based on root moments

Neural Computation
A new constrained learning algorithm for function approximation by encoding a priori information into feedforward neural networks

Neural Computing and Applications
A fuzzy neighborhood-based training algorithm for feedforward neural networks

Neural Computing and Applications
A new modified hybrid learning algorithm for feedforward neural networks

ISNN'05 Proceedings of the Second international conference on Advances in Neural Networks - Volume Part I
Magnified gradient function with deterministic weight modification in adaptive learning

IEEE Transactions on Neural Networks
An efficient constrained training algorithm for feedforward networks

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, a constrained learning algorithm is proposed for function approximation. The algorithm incorporates constraints into single hidden layered feedforward neural networks from the a priori information of the approximated function. The activation functions of the hidden neurons are specific polynomial functions based on Taylor series expansions, and the connection weight constraints are obtained from the second-order derivative information of the approximated function. The new algorithm has been shown by experimental results to have better generalization performance than other traditional learning ones.