Deeper Sparsely Nets can be Optimal

  • Authors:
  • Valeriu Beiu;Hanna E. Makaruk

  • Affiliations:
  • Space & Atmospheric Div. NIS–1, MS D466, and Theoretical Div. T–13 MS B213, Los Alamos National Laboratory, Los Alamos, New Mexico 87545, USA Email: beiu@lanl.gov;Space & Atmospheric Div. NIS–1, MS D466, and Theoretical Div. T–13 MS B213, Los Alamos National Laboratory, Los Alamos, New Mexico 87545, USA Email: beiu@lanl.gov

  • Venue:
  • Neural Processing Letters
  • Year:
  • 1998

Quantified Score

Hi-index 0.00

Visualization

Abstract

The starting points of thispaper are two size-optimal solutions: (i) one forimplementing arbitraryBoolean functions [1]; and (ii) another one forimplementing certainsub-classes of Boolean functions [2]. Because VLSIimplementationsdo not cope well with highly interconnectednets – the area of achip grows with the cube of the fan-in[3] – this paper will analysethe influence of limited fan-in on the size optimalityfor the twosolutions mentioned. First, we will extend a resultfrom Horne & Hush[1] valid for fan-ins &Dgr; = 2 toarbitrary fan-in. Second,we will prove that size-optimal solutions are obtainedfor small constantfan-in for both constructions, while relative minimumsize solutionscan be obtained for fan-ins strictly lower thanlinear. These resultsare in agreement with similar ones proving that forsmall constantfan-ins (&Dgr; = 6 ... 9), thereexist VLSI-optimal (i.e.,minimising AT2) solutions[4], while there aresimilar small constants relating to our capacity ofprocessing information [5].