A goal programming based approach for hidden targets in layer-by-layer algorithm of multilayer perceptron classifiers

Authors:
Yanlai Li;Kuanquan Wang;Tao Li
Affiliations:
School of Computer Science and Technology, Harbin Institute of Technology, Harbin, P.R. China;School of Computer Science and Technology, Harbin Institute of Technology, Harbin, P.R. China;School of Computer Science and Technology, Harbin Institute of Technology, Harbin, P.R. China
Venue:
ISNN'06 Proceedings of the Third international conference on Advances in Neural Networks - Volume Part I
Year:
2006

Citing 2
Cited 0

A fast multilayer neural-network training algorithm based on the layer-by-layer optimizing procedures

IEEE Transactions on Neural Networks
An accelerated learning algorithm for multilayer perceptrons: optimization layer by layer

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

Layer-by-layer (LBL) algorithm is one of the famous training algorithms for multilayer perceptrons. It converges fast with less computation complexity. Unfortunately, in LBL, when calculating the desired hidden targets, solving of a linear equation set is needed. If the determinant of the coefficient matrix turns to be zero, the solution will not be unique. That results in the stalling problem. Furthermore, a truncation error will be caused by the inversing process of sigmoid function. Based on the idea of goal programming technique, this paper proposes a new method to calculate the hidden targets. A satisfied solution of hidden targets is provided through a goal programming model. Furthermore, the truncation error can be avoided efficiently by means of assigning higher priority to the limitation of variable domain. The effectiveness of the proposed method is demonstrated by the computer simulation of a mushroom classification problem.