The vc dimension and pseudodimension of two-layer neural networks with discrete inputs

  • Authors:
  • Peter L. Bartlett;Robert C. Williamson

  • Affiliations:
  • Department of Systems Engineering, Research School of Information Sciences and Engineering, Australian National University, Canberra 0200, Australia;Department of Systems Engineering, Research School of Information Sciences and Engineering, Australian National University, Canberra 0200, Australia

  • Venue:
  • Neural Computation
  • Year:
  • 1996

Quantified Score

Hi-index 0.00

Visualization

Abstract

We give upper bounds on the Vapnik-Chervonenkis dimension and pseudodimension of two-layer neural networks that use the standard sigmoid function or radial basis function and have inputs from {-D,...,D}n. In Valiant's probably approximately correct (pac) learning framework for pattern classification, and in Haussler's generalization of this framework to nonlinear regression, the results imply that the number of training examples necessary for satisfactory learning performance grows no more rapidly than W log (WD), where W is the number of weights. The previous best bound for these networks was O(W4).