IEEE Transactions on Neural Networks
The geometrical learning of binary neural networks
IEEE Transactions on Neural Networks
A learning style classification mechanism for e-learning
Computers & Education
Neural architectures optimization and genetic algorithms
WSEAS Transactions on Computers
A novel pruning algorithm for self-organizing neural network
IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
| Hi-index | 0.00 |
Almost all current training algorithms for neural networks are based on gradient descending technique, which causes long training time. In this paper, we propose a novel fast training algorithm called Fast Constructive-Covering Algorithm (FCCA) for neural network construction based on geometrical expansion. Parameters are updated according to the geometrical location of the training samples in the input space, and each sample in the training set is learned only once. By doing this, FCCA is able to avoid iterative computing and much faster than traditional training algorithms. Given an input sequence in an arbitrary order, FCCA learns ''easy'' samples first and ''confusing'' samples are easily learned after these ''easy'' samples. This sample reordering process is done on the fly based on geometrical concept. In addition, FCCA begins with an empty hidden layer, and adds new hidden neurons when necessary. This constructive learning avoids blind selection of neural network structure. The experimental work for classification problems illustrates the advantages of FCCA, especially in learning speed.