Artificial Neural Networks with Adaptive Multidimensional Spline Activation Functions

  • Authors:
  • Affiliations:
  • Venue:
  • IJCNN '00 Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 3 - Volume 3
  • Year:
  • 2000

Quantified Score

Hi-index 0.00

Visualization

Abstract

This work concerns a new kind of neural structure that involves a multidimensional adaptive activation function. The proposed architecture, based on multi-dimensional cubic spline, allows collecting information from the previous network layer in aggregate form. In other words, the number of network connections (structural complexity) can be very low respect to the problem complexity. This fact, as experimentally demonstrated in the paper, improve the network generalization capabilities and speed up the convergence of the learning process. A specific learning algorithm is derived and experimental results, demonstrate the effectiveness of the proposed architecture.