Feature hashing for large scale multitask learning

  • Authors:
  • Kilian Weinberger;Anirban Dasgupta;John Langford;Alex Smola;Josh Attenberg

  • Affiliations:
  • Yahoo! Research, Santa Clara, CA;Yahoo! Research, Santa Clara, CA;Yahoo! Research, Santa Clara, CA;Yahoo! Research, Santa Clara, CA;Yahoo! Research, Santa Clara, CA

  • Venue:
  • ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Empirical evidence suggests that hashing is an effective strategy for dimensionality reduction and practical nonparametric estimation. In this paper we provide exponential tail bounds for feature hashing and show that the interaction between random subspaces is negligible with high probability. We demonstrate the feasibility of this approach with experimental results for a new use case --- multitask learning with hundreds of thousands of tasks.