Agglomerative grouping of observations by bounding entropy variation

  • Authors:
  • Christian Beder

  • Affiliations:
  • Institute for Photogrammetry, Bonn University, Germany

  • Venue:
  • PR'05 Proceedings of the 27th DAGM conference on Pattern Recognition
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

An information theoretic framework for grouping observations is proposed. The entropy change incurred by new observations is analyzed using the Kalman filter update equations. It is found, that the entropy variation is caused by a positive similarity term and a negative proximity term. Bounding the similarity term in the spirit of the minimum description length principle and the proximity term in the spirit of maximum entropy inference a robust and efficient grouping procedure is devised. Some of its properties are demonstrated for the exemplary task of edgel grouping.