Multi-task learning for boosting with application to web search ranking

  • Authors:
  • Olivier Chapelle;Pannagadatta Shivaswamy;Srinivas Vadrevu;Kilian Weinberger;Ya Zhang;Belle Tseng

  • Affiliations:
  • Yahoo! Labs, Sunnyvale, CA, USA;Columbia University, New York, NY, USA;Yahoo! Labs, Sunnyvale, CA, USA;Washington University, Saint Louis, MO, USA;Shanghai Jiao Tong University, Shanghai, China;Yahoo! Labs, Sunnyvale, CA, USA

  • Venue:
  • Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we propose a novel algorithm for multi-task learning with boosted decision trees. We learn several different learning tasks with a joint model, explicitly addressing the specifics of each learning task with task-specific parameters and the commonalities between them through shared parameters. This enables implicit data sharing and regularization. We evaluate our learning method on web-search ranking data sets from several countries. Here, multitask learning is particularly helpful as data sets from different countries vary largely in size because of the cost of editorial judgments. Our experiments validate that learning various tasks jointly can lead to significant improvements in performance with surprising reliability.