Original Contribution: Local conditions for phase transitions in neural networks with variable connection strengths

Authors:
Frank E. McFadden;Yun Peng;James A. Reggia
Affiliations:
College Park, USA and University of Maryland, USA;Baltimore County, USA and University of Maryland, USA;College Park, USA and Baltimore, USA and University of Maryland, USA
Venue:
Neural Networks
Year:
1993

Citing 4
Cited 2

Phase transitions in artificial intelligence systems

Artificial Intelligence
The performance of cooperative processes

CNLS '89 Proceedings of the ninth annual international conference of the Center for Nonlinear Studies on Self-organizing, Collective, and Cooperative Phenomena in Natural and Artificial Computing Networks on Emergent computation
Phase transitions in connectionist models having rapidly varying connection strengths

Neural Computation
Virtual uteral inhibition in parallel activation models of associative memory

IJCAI'85 Proceedings of the 9th international joint conference on Artificial intelligence - Volume 1

Boundary conditions and phase transitions in neural networks. Theoretical results

Neural Networks
Input Feedback Networks: Classification and Inference Based on Network Structure

Proceedings of the 2008 conference on Artificial General Intelligence 2008: Proceedings of the First AGI Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

Qualitative changes in the behavior of a neural network may occur when parameters cross critical boundaries. These phase transitions may be triggered either by learning or by the intrinsic dynamics of the network, and must be understood in order to guarantee that the behavior of the model will be meaningful. This is particularly important for models with connection strengths that are permitted to vary rapidly. Such models, which have been applied to a variety of problems in computer science, neuroscience, and cognitive science, may display transitions from phases characterized by bounded total activation to phases during which total activation may grow explosively. It has been observed, however, that even when total network activation remains bounded, individual node activations can grow without limit. In this paper, local conditions for boundedness and divergence are derived, in the form of a balance between each node's decay vs the gain it imparts to the rest of the system. These conditions do not require that the connection matrix be symmetric. These results extend the range of models whose phase transitions are understood and, therefore, expand the choices of well-behaved models that may be selected for applications.