Recurrent infomax generates cell assemblies, neuronal avalanches, and simple cell-like selectivity

Authors:
Takuma Tanaka;Takeshi Kaneko;Toshio Aoyagi
Affiliations:
Department of Morphological Brain Science, Graduate School of Medicine, Kyoto University, Kyoto, Japan;Department of Morphological Brain Science, Graduate School of Medicine, Kyoto University, Kyoto, Japan and CREST, Japan Science and Technology Agency, Kawaguchi, Saitama, Japan;Department of Applied Analysis and Complex Dynamical Systems, Graduate School of Informatics, Kyoto University, Kyoto, Japan and CREST, Japan Science and Technology Agency, Kawaguchi, Saitama, Jap ...
Venue:
Neural Computation
Year:
2009

Citing 6
Cited 0

Self-Organization in a Perceptual Network

Computer
Elements of information theory

Elements of information theory
An information-maximization approach to blind separation and blind deconvolution

Neural Computation
Real-time computing without stable states: a new framework for neural computation based on perturbations

Neural Computation
Locality of global stochastic interaction in directed acyclic networks

Neural Computation
Optimal spike-timing-dependent plasticity for precise action potential firing in supervised learning

Neural Computation

Quantified Score

Hi-index	0.00

Visualization

Abstract

Recently multineuronal recording has allowed us to observe patterned firings, synchronization, oscillation, and global state transitions in the recurrent networks of central nervous systems. We propose a learning algorithm based on the process of information maximization in a recurrent network, which we call recurrent infomax (RI). RI maximizes information retention and thereby minimizes information loss through time in a network. We find that feeding in external inputs consisting of information obtained from photographs of natural scenes into an RI-based model of a recurrent network results in the appearance of Gabor-like selectivity quite similar to that existing in simple cells of the primary visual cortex. We find that without external input, this network exhibits cell assembly-like and synfire chain-like spontaneous activity as well as a critical neuronal avalanche. In addition, we find that RI embeds externally input temporal firing patterns to the network so that it spontaneously reproduces these patterns after learning. RI provides a simple framework to explain a wide range of phenomena observed in in vivo and in vitro neuronal networks, and it will provide a novel understanding of experimental results for multineuronal activity and plasticity from an information-theoretic point of view.