An efficient algorithm for local distance metric learning

  • Authors:
  • Liu Yang;Rong Jin;Rahul Sukthankar;Yi Liu

  • Affiliations:
  • Michigan State University, Dept. of Computer Science & Engineering, East Lansing, MI;Michigan State University, Dept. of Computer Science & Engineering, East Lansing, MI;Intel Research & Carnegie Mellon, Pittsburgh, PA;Michigan State University, Dept. of Computer Science & Engineering, East Lansing, MI

  • Venue:
  • AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Learning application-specific distance metrics from labeled data is critical for both statistical classification and information retrieval. Most of the earlier work in this area has focused on finding metrics that simultaneously optimize compactness and separability in a global sense. Specifically, such distance metrics attempt to keep all of the data points in each class close together while ensuring that data points from different classes are separated. However, particularly when classes exhibit multimodal data distributions, these goals conflict and thus cannot be simultaneously satisfied. This paper proposes a Local Distance Metric (LDM) that aims to optimize local compactness and local separability. We present an efficient algorithm that employs eigenvector analysis, and bound optimization to learn the LDM from training data in a probabilistic framework. We demonstrate that LDM achieves significant improvements in both classification and retrieval accuracy compared to global distance learning and kernel-based KNN.