Neural network tomography: Network replication from output surface geometry

  • Authors:
  • Rupert C. J. Minnett;Andrew T. Smith;William C. Lennon, Jr.;Robert Hecht-Nielsen

  • Affiliations:
  • Electrical and Computer Engineering Department, University of California, San Diego, La Jolla, CA 92093-0407, United States;Computer Science and Engineering Department, University of California, San Diego, La Jolla, CA 92093-0404, United States;Electrical and Computer Engineering Department, University of California, San Diego, La Jolla, CA 92093-0407, United States;Electrical and Computer Engineering Department, University of California, San Diego, La Jolla, CA 92093-0407, United States

  • Venue:
  • Neural Networks
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Multilayer perceptron networks whose outputs consist of affine combinations of hidden units using the tanh activation function are universal function approximators and are used for regression, typically by reducing the MSE with backpropagation. We present a neural network weight learning algorithm that directly positions the hidden units within input space by numerically analyzing the curvature of the output surface. Our results show that under some sampling requirements, this method can reliably recover the parameters of a neural network used to generate a data set.