On the Parsimony of the Multi-Layer Perceptrons when ProcessingEncoded Symbolic Variables

  • Authors:
  • D. Bonnet;A. Grumbach;V. Labouisse

  • Affiliations:
  • Dé/partement Informatique, É/cole Nationale Supé/rieure des Té/lé/communications, Paris. E-mail: Email: grumbach@inf.enst.fr/;Dé/partement Informatique, É/cole Nationale Supé/rieure des Té/lé/communications, Paris. E-mail: Email: grumbach@inf.enst.fr/;Dé/partement Recherche Prospective, Direction de la Recherche, SNCF, Paris

  • Venue:
  • Neural Processing Letters
  • Year:
  • 1998

Quantified Score

Hi-index 0.00

Visualization

Abstract

This article addresses the issue of symbolic processing with Multi-LayerPerceptrons through encoding. Given an encoding, we propose a lower boundof the number of parameters for an MLP to perform a random mapping of itsinput symbolic space to its output symbolic space. In the case of what wecall binary encoding, the needed number of parameters may betheoretically computed. Given these two results, we show that the mostefficient encodings are the ones which use one input unit per value.