Building enriched document representations using aggregated anchor text

  • Authors:
  • Donald Metzler;Jasmine Novak;Hang Cui;Srihari Reddy

  • Affiliations:
  • Yahoo! Labs, Santa Clara, CA, USA;Yahoo! Labs, Santa Clara, CA, USA;Yahoo! Labs, Santa Clara, CA, USA;Yahoo! Labs, Santa Clara, CA, USA

  • Venue:
  • Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

It is well known that anchor text plays a critical role in a variety of search tasks performed over hypertextual domains, including enterprise search, wiki search, and web search. It is common practice to enrich a document's standard textual representation with all of the anchor text associated with its incoming hyperlinks. However, this approach does not help match relevant pages with very few inlinks. In this paper, we propose a method for overcoming anchor text sparsity by enriching document representations with anchor text that has been aggregated across the hyperlink graph. This aggregation mechanism acts to smooth, or diffuse, anchor text within a domain. We rigorously evaluate our proposed approach on a large web search test collection. Our results show the approach significantly improves retrieval effectiveness, especially for longer, more difficult queries.