A novel learning algorithm for feedforward neural networks

Authors:
Huawei Chen;Fan Jin
Affiliations:
School of Information Science & Technology, Southwest Jiaotong University, Chengdu, Sichuan, China;School of Information Science & Technology, Southwest Jiaotong University, Chengdu, Sichuan, China
Venue:
ISNN'06 Proceedings of the Third international conference on Advances in Neural Networks - Volume Part I
Year:
2006

Citing 5
Cited 0

Multilayer feedforward networks are universal approximators

Neural Networks
Learning internal representations by error propagation

Parallel distributed processing: explorations in the microstructure of cognition, vol. 1
The sample complexity of pattern classification with neural networks: the size of the weights is more important than the size of the network

IEEE Transactions on Information Theory
Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions

IEEE Transactions on Neural Networks
Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

A novel learning algorithm called BPWA for feedforward neural networks is presented, which adjusts the weights during both forward phase and backward phase. It calculates the minimum norm square solution as the weights between the hidden layer and output layer in the forward pass, while the backward pass adjusts the weights connecting the input layer to hidden layer according to error gradient descent algorithm. The algorithm is compared with Extreme learning Machine, BP algorithm and LMBP algorithm on function approximation and classification tasks. The experiments’ results demonstrate that the proposed algorithm performs well.