FINE: Fisher Information Nonparametric Embedding

  • Authors:
  • Kevin M. Carter;Raviv Raich;William G. Finn;Alfred O. Hero III

  • Affiliations:
  • Information Systems Technology Group, Lexington;Oregon State University, Corvallis;University of Michigan, Ann Arbor;University of Michigan, Ann Arbor

  • Venue:
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Year:
  • 2009

Quantified Score

Hi-index 0.15

Visualization

Abstract

We consider the problems of clustering, classification, and visualization of high-dimensional data when no straightforward euclidean representation exists. In this paper, we propose using the properties of information geometry and statistical manifolds in order to define similarities between data sets using the Fisher information distance. We will show that this metric can be approximated using entirely nonparametric methods, as the parameterization and geometry of the manifold is generally unknown. Furthermore, by using multidimensional scaling methods, we are able to reconstruct the statistical manifold in a low-dimensional euclidean space; enabling effective learning on the data. As a whole, we refer to our framework as Fisher Information Nonparametric Embedding (FINE) and illustrate its uses on practical problems, including a biomedical application and document classification.