Sketching Algorithms for Approximating Rank Correlations in Collaborative Filtering Systems

  • Authors:
  • Yoram Bachrach;Ralf Herbrich;Ely Porat

  • Affiliations:
  • Microsoft Research Ltd., Cambridge, UK;Microsoft Research Ltd., Cambridge, UK;Department of Computer Science, Bar-Ilan University, Ramat-Gan, Israel

  • Venue:
  • SPIRE '09 Proceedings of the 16th International Symposium on String Processing and Information Retrieval
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Collaborative filtering (CF) shares information between users to provide each with recommendations. Previous work suggests using sketching techniques to handle massive data sets in CF systems, but only allows testing whether users have a high proportion of items they have both ranked. We show how to determine the correlation between the rankings of two users, using concise "sketches" of the rankings. The sketches allow approximating Kendall's Tau, a known rank correlation, with high accuracy *** and high confidence 1 *** *** . The required sketch size is logarithmic in the confidence and polynomial in the accuracy.