Extracting user profiles from large scale data

  • Authors:
  • Michal Shmueli-Scheuer;Haggai Roitman;David Carmel;Yosi Mass;David Konopnicki

  • Affiliations:
  • IBM Research, Haifa;IBM Research, Haifa;IBM Research, Haifa;IBM Research, Haifa;IBM Research, Haifa

  • Venue:
  • Proceedings of the 2010 Workshop on Massive Data Analytics on the Cloud
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this work we present the details of a large scale user profiling framework that we developed here in IBM on top of Apache Hadoop. We address the problem of extracting and maintaining a very large number of user profiles from large scale data. We first describe an efficient user profiling framework with high user profiling quality guarantees. We then describe a scalable implementation of the proposed framework in Apache Hadoop and discuss its challenges.