Interpreting hidden neurons in boolean constructive neural networks

  • Authors:
  • Maria do Carmo Nicoletti;João R. Bertini;Osvaldo Luiz de Oliveira

  • Affiliations:
  • CS Dept, UFSCar, S. Carlos, SP, Brazil and FACCAMP, Campo Limpo Paulista, SP, Brazil;ICMC, USP, S. Carlos, SP, Brazil;FACCAMP, Campo Limpo Paulista, SP, Brazil

  • Venue:
  • IDEAL'11 Proceedings of the 12th international conference on Intelligent data engineering and automated learning
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

A particular group of neural network (NN) learning algorithms known as constructive algorithms (CoNN) congregates algorithms that dynamically combine two processes: (1) the definition of the NN architecture and (2) learning. Generally both processes alternate, depending on each others performance. During training CoNN algorithms incrementally add hidden neurons and connections to the network until some stopping criterion is satisfied. This paper describes an investigation into the semantic role played by the hidden neurons added into the NN, when learning Boolean functions. Five CoNN algorithms namely Tower, Pyramid, Tiling, Perceptron-Cascade and Shift are examined in that respect. Results show that hidden neurons represent Boolean sub-expressions whose combination represents a disjunction of prime implicants.