Multi-output regression on the output manifold

  • Authors:
  • Guangcan Liu;Zhouchen Lin;Yong Yu

  • Affiliations:
  • Shanghai Jiao Tong University, Shanghai 200240, PR China;Microsoft Research Asia, Zhichun Road #49, Haidian District, Beijing 100190, PR China;Shanghai Jiao Tong University, Shanghai 200240, PR China

  • Venue:
  • Pattern Recognition
  • Year:
  • 2009

Quantified Score

Hi-index 0.01

Visualization

Abstract

Multi-output regression aims at learning a mapping from an input feature space to a multivariate output space. Previous algorithms define the loss functions using a fixed global coordinate of the output space, which is equivalent to assuming that the output space is a whole Euclidean space with a dimension equal to the number of the outputs. So the underlying structure of the output space is completely ignored. In this paper, we consider the output space as a Riemannian submanifold to incorporate its geometric structure into the regression process. To this end, we propose a novel mechanism, called locally linear transformation (LLT), to define the loss functions on the output manifold. In this way, currently existing regression algorithms can be improved. In particular, we propose an algorithm under the support vector regression framework. Our experimental results on synthetic and real-life data are satisfactory.