Learning in neural network: unusual effects of “artificial dreams”

  • Authors:
  • Ryszard Tadeusiewicz;Andrzej Izworski

  • Affiliations:
  • Department of Automatics, AGH University of Science and Technology, Kraków, Poland;Department of Automatics, AGH University of Science and Technology, Kraków, Poland

  • Venue:
  • ICONIP'06 Proceedings of the 13 international conference on Neural Information Processing - Volume Part I
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Most researchers focused on particular result ignore intermediate stages of learning process of neural networks. The unstable and transitory phenomena, discovered in neural networks during the learning process, long time after the initial stage of learning, when the network knows nothing because of random values of all weights, and long time before final stage of learning process, when the network knows (almost) everything – can be very interesting, especially when we can associate with them some psychological interpretations. Some "immature" neurons exhibit behavior that can be interpreted as source of "artificial dreams". Article presents examples of simple neural networks with capabilities which might explain the origins of dreams and myths.