Metabolically Efficient Information Processing

Authors:
Vijay Balasubramanian;Don Kimber;Michael J. Berry, II
Affiliations:
Jefferson Laboratory of Physics, Harvard University, Cambridge, MA 02138, U.S.A.;FX Palo Alto Laboratory, Palo Alto, CA 94304, U.S.A.;Department of Molecular Biology, Princeton University, Princeton, NJ 08544, U.S.A.
Venue:
Neural Computation
Year:
2001

Citing 5
Cited 4

Principles and practice of information theory

Principles and practice of information theory
Elements of information theory

Elements of information theory
Analog versus digital: extrapolating from electronics to neurobiology

Neural Computation
Spikes: exploring the neural code

Spikes: exploring the neural code
Energy efficient neural codes

Neural Computation

Energy-efficient coding with discrete stochastic events

Neural Computation
Enhancement of information transmission efficiency by synaptic failures

Neural Computation
A novel hierarchical model of attention: maximizing information acquisition

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part I
Energy-based stochastic control of neural mass models suggests time-varying effective connectivity in the resting state

Journal of Computational Neuroscience

Quantified Score

Hi-index	0.00

Visualization

Abstract

Energy-efficient information transmission may be relevant to biological sensory signal processing as well as to low-power electronic devices. We explore its consequences in two different regimes. In an "immediate" regime, we argue that the information rate should be maximized subject to a power constraint, and in an "exploratory" regime, the transmission rate per power cost should be maximized. In the absence of noise, discrete inputs are optimally encoded into Boltzmann distributed output symbols. In the exploratory regime, the partition function of this distribution is numerically equal to 1. The structure of the optimal code is strongly affected by noise in the transmission channel. The Arimoto-Blahut algorithm, generalized for cost constraints, can be used to derive and interpret the distribution of symbols for optimal energy-efficient coding in the presence of noise. We outline the possibilities and problems in extending our results to information coding and transmission in neurobiological systems.