Partitioned neural networks

  • Authors:
  • Douglas P. Sutton;Martin C. Carlisle;Traci A. Sarmiento;Leemon C. Baird

  • Affiliations:
  • United States Air Force Academy, Colorado Springs, CO;United States Air Force Academy, Colorado Springs, CO;United States Air Force Academy, Colorado Springs, CO;United States Air Force Academy, Colorado Springs, CO

  • Venue:
  • IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

A new method is given for speeding up learning in a deep neural network with many hidden layers, by partially partitioning the network rather than fully interconnecting the layers. Empirical results are shown both for learning a simple Boolean function on a standard backprop network, and for learning two different, complex, real-world vision tasks on a more sophisticated convolutional network. In all cases, the performance of the proposed system was better than traditional systems. The partially-partitioned network outperformed both the fully-partitioned and fully-unpartitioned networks.