A scalable randomized method to compute link-based similarity rank on the web graph

  • Authors:
  • Dániel Fogaras;Balázs Rácz

  • Affiliations:
  • Computer and Automation Research Institute of the Hungarian Academy of Sciences;Computer and Automation Research Institute of the Hungarian Academy of Sciences

  • Venue:
  • EDBT'04 Proceedings of the 2004 international conference on Current Trends in Database Technology
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Several iterative hyperlink-based similarity measures were published to express the similarity of web pages However, it usually seems hopeless to evaluate complex similarity functions over large repositories containing hundreds of millions of pages.We introduce scalable algorithms computing SimRank scores, which express the contextual similarities of pages based on the hyperlink structure The proposed methods scale well to large repositories, fulfilling strict requirements about computational complexity The algorithms were tested on a set of ten million pages, but parallelization techniques make it possible to compute the SimRank scores even for the entire web with over 4 billion pages The key idea is that randomized Monte Carlo methods combined with indexing techniques yield a scalable approximation of SimRank.