A Local Learning Rule That Enables Information Maximization for Arbitrary Input Distributions

  • Authors:
  • Ralph Linsker

  • Affiliations:
  • IBM Research Division, T. J. Watson Research Center, Yorktown Heights, NY 10598, U.S.A.

  • Venue:
  • Neural Computation
  • Year:
  • 1997

Quantified Score

Hi-index 0.00

Visualization

Abstract

This note presents a local learning rule that enables a network to maximize the mutual information between input and output vectors. The network's output units may be nonlinear, and the distribution of input vectors is arbitrary. The local algorithm also serves to compute the inverse C-1 of an arbitrary square connection weight matrix.