Exploiting the hierarchical structure for link analysis

  • Authors:
  • Gui-Rong Xue;Qiang Yang;Hua-Jun Zeng;Yong Yu;Zheng Chen

  • Affiliations:
  • Shanghai Jiao-Tong University, Shanghai, P. R. China;Hong Kong University of Science and Technology Clearwater Bay, Kowloon, Hong Kong;Microsoft Research Asia, Beijing, P. R. China;Shanghai Jiao-Tong University, Shanghai, P. R. China;Microsoft Research Asia, Beijing, P. R. China, Shanghai Jiao-Tong University, Shanghai, P. R. China

  • Venue:
  • Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Link analysis algorithms have been extensively used in Web information retrieval. However, current link analysis algorithms generally work on a flat link graph, ignoring the hierarchal structure of the Web graph. They often suffer from two problems: the sparsity of link graph and biased ranking of newly-emerging pages. In this paper, we propose a novel ranking algorithm called Hierarchical Rank as a solution to these two problems, which considers both the hierarchical structure and the link structure of the Web. In this algorithm, Web pages are first aggregated based on their hierarchical structure at directory, host or domain level and link analysis is performed on the aggregated graph. Then, the importance of each node on the aggregated graph is distributed to individual pages belong to the node based on the hierarchical structure. This algorithm allows the importance of linked Web pages to be distributed in the Web page space even when the space is sparse and contains new pages. Experimental results on the .GOV collection of TREC 2003 and 2004 show that hierarchical ranking algorithm consistently outperforms other well-known ranking algorithms, including the PageRank, BlockRank and LayerRank. In addition, experimental results show that link aggregation at the host level is much better than link aggregation at either the domain or directory levels.