Penalty OBS Scheme for Feedforward Neural Network

Authors:
Jiang Meng
Affiliations:
North University of China
Venue:
ICTAI '05 Proceedings of the 17th IEEE International Conference on Tools with Artificial Intelligence
Year:
2005

Citing 0
Cited 1

Levenberg-Marquardt-based OBS algorithm using adaptive pruning interval for system identification with dynamic neural networks

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presented a new scheme called penalty OBS (Optimal Brain Surgeon) for the feedforward neural network learning. The penalty OBS scheme takes OBS pruning case as a penalty item of the network cost function, and develops two applied methods based on the common algorithms of network learning. As a novel revision of OBS, the new scheme not only saves the runtime to calculate Hessian matrix after training, but also improves the generalization a lot and keeps over-linear rapidity of convergence. The simulating results verified the advantages.