Multi-task averaging via task clustering

  • Authors:
  • David Martínez-Rego;Massimiliano Pontil

  • Affiliations:
  • LIDIA Group, Department of Computer Science, University of A Coruña, A Coruña, Spain;Centre for Computational Statistics and Machine Learning, Department of Computer Science, University College London, London, UK

  • Venue:
  • SIMBAD'13 Proceedings of the Second international conference on Similarity-Based Pattern Recognition
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Multi-task averaging deals with the problem of estimating the means of a set of distributions jointly. It has its roots in the fifties when it was observed that leveraging data from related distributions can yield superior performance over learning from each distribution independently. Stein's paradox showed that, in an average square error sense, it is better to estimate the means of T Gaussian random variables using data sampled from all of them. This phenomenon has been largely disregarded and has recently emerged again in the field of multi-task learning. In this paper, we extend recent results for multi-task averaging to the n-dimensional case and propose a method to detect from data which tasks/distributions should be considered as related. Our experimental results indicate that the proposed method compares favorably to the state of the art.