The bootstrap widrow-hoff rule as a cluster-formation algorithm

  • Authors:
  • Geoffrey E. Hinton;Steven J. Nowlan

  • Affiliations:
  • Department of Computer Science, University of Toronto, 10 King's College Road, Toronto M5S 1A4, Canada;Department of Computer Science, University of Toronto, 10 King's College Road, Toronto M5S 1A4, Canada

  • Venue:
  • Neural Computation
  • Year:
  • 1990

Quantified Score

Hi-index 0.00

Visualization

Abstract

An algorithm that is widely used for adaptive equalization in current modems is the bootstrap or decision-directed version of the Widrow-Hoff rule. We show that this algorithm can be viewed as an unsupervised clustering algorithm in which the data points are transformed so that they form two clusters that are as tight as possible. The standard algorithm performs gradient ascent in a crude model of the log likelihood of generating the transformed data points from two gaussian distributions with fixed centers. Better convergence is achieved by using the exact gradient of the log likelihood.