Learning of highly-filtered data manifold using spectral methods

  • Authors:
  • Oleg Roderick;Ilya Safro

  • Affiliations:
  • Argonne National Laboratory, Argonne, IL;Argonne National Laboratory, Argonne, IL

  • Venue:
  • LION'10 Proceedings of the 4th international conference on Learning and intelligent optimization
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a scheme for improving existing tools for recovering and predicting decisions based on singular value decomposition. Our main contribution is an investigation of advantages of using a functional, rather than linear approximation of the response of an unknown, complicated model. A significant attractive feature of the method is the demonstrated ability to make predictions based on a highly filtered data set. An adaptive high-order interpolation is constructed, that estimates the relative probability of each possible decision. The method uses a flexible nonlinear basis, capable of utilizing all the available information. We demonstrate that the prediction can be based on a very small fraction of the training set. The suggested approach is relevant in the general field of manifold learning, as a tool for approximating the response of the models based on many parameters. Our experiments show that the approach is at least competitive with other latent factor prediction methods, and that the precision of prediction grows with the increase in the order of the polynomial basis.