Learning semantics-preserving distance metrics for clustering graphical data

  • Authors:
  • Aparna S. Varde;Elke A. Rundensteiner;Carolina Ruiz;Mohammed Maniruzzaman;Richard D. Sisson, Jr.

  • Affiliations:
  • Worcester Polytechnic Institute (WPI), Worcester, MA;Worcester Polytechnic Institute (WPI), Worcester, MA;Worcester Polytechnic Institute (WPI), Worcester, MA;Worcester Polytechnic Institute (WPI), Worcester, MA;Worcester Polytechnic Institute (WPI), Worcester, MA

  • Venue:
  • MDM '05 Proceedings of the 6th international workshop on Multimedia data mining: mining integrated media and complex data
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

In mining graphical data the default Euclidean distance is often used as a notion of similarity. However this does not adequately capture semantics in our targeted domains, having graphical representations depicting results of scientific experiments. It is seldom known a-priori what other distance metric best preserves semantics. This motivates the need to learn such a metric. A technique called LearnMet is proposed here to learn a domain-specific distance metric for graphical representations. Input to LearnMet is a training set of correct clusters of such graphs. LearnMet iteratively compares these correct clusters with those obtained from an arbitrary but fixed clustering algorithm. In the first iteration a guessed metric is used for clustering. This metric is then refined using the error between the obtained and correct clusters until the error is below a given threshold. LearnMet is evaluated rigorously in the Heat Treating domain which motivated this research. Clusters obtained using the learned metric and clusters obtained using Euclidean distance are both compared against the correct clusters over a separate test set. Our results show that the learned metric provides better clusters.