User-Based Collaborative-Filtering Recommendation Algorithms on Hadoop

  • Authors:
  • Zhi-Dan Zhao;Ming-sheng Shang

  • Affiliations:
  • -;-

  • Venue:
  • WKDD '10 Proceedings of the 2010 Third International Conference on Knowledge Discovery and Data Mining
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Collaborative Filtering(CF) algorithms are widely used in a lot of recommender systems, however, the computational complexity of CF is high thus hinder their use in large scale systems. In this paper, we implement user-based CF algorithm on a cloud computing platform, namely Hadoop, to solve the scalability problem of CF. Experimental results show that a simple method that partition users into groups according to two basic principles, i.e., tidy arrangement of mapper number to overcome the initiation of mapper and partition task equally such that all processors finish task at the same time, can achieve linear speedup.