Topic distillation via sub-site retrieval

Authors:
Tao Qin;Tie-Yan Liu;Xu-Dong Zhang;Guang Feng;De-Sheng Wang;Wei-Ying Ma
Affiliations:
MSP Laboratory, Department of Electronic Engineering, Tsinghua University, Beijing, PR China;Microsoft Research Asia, Haidian District, Beijing, PR China;MSP Laboratory, Department of Electronic Engineering, Tsinghua University, Beijing, PR China;MSP Laboratory, Department of Electronic Engineering, Tsinghua University, Beijing, PR China;MSP Laboratory, Department of Electronic Engineering, Tsinghua University, Beijing, PR China;Microsoft Research Asia, Haidian District, Beijing, PR China
Venue:
Information Processing and Management: an International Journal - Special issue: AIRS2005: Information retrieval research in Asia
Year:
2007

Citing 10
Cited 2

Improved algorithms for topic distillation in a hyperlinked environment

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
The anatomy of a large-scale hypertextual Web search engine

WWW7 Proceedings of the seventh international conference on World Wide Web 7
Authoritative sources in a hyperlinked environment

Journal of the ACM (JACM)
Integrating the document object model with hyperlinks for enhanced topic distillation and information extraction

Proceedings of the 10th international conference on World Wide Web
When experts agree: using non-affiliated experts to rank popular topics

Proceedings of the 10th international conference on World Wide Web
Enhanced topic distillation using text, markup tags, and hyperlinks

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Modern Information Retrieval

Modern Information Retrieval
A taxonomy of web search

ACM SIGIR Forum
A study of relevance propagation for web search

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Level-based link analysis

APWeb'05 Proceedings of the 7th Asia-Pacific web conference on Web Technologies Research and Development

Learning to rank relational objects and its application to web search

Proceedings of the 17th international conference on World Wide Web
A generic construct based workload model for web search

Information Processing and Management: an International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

Topic distillation is one of the main information needs when users search the Web. Previous approaches for topic distillation treat single page as the basic searching unit, which has not fully utilized the structure information of the Web. In this paper, we propose a novel concept for topic distillation, named sub-site retrieval, in which the basic searching unit is sub-site instead of single page. A sub-site is the subset of a website, consisting of a structural collection of pages. The key of sub-site retrieval includes (1) extracting effective features for the representation of a sub-site using both the content and structure information, (2) delivering the sub-site-based retrieval results with a friendly and informative user interface. For the first point, we propose Punished Integration algorithm, which is based on the modeling of the growth of websites. For the second point, we design a user interface to better illustrate the search results of sub-site retrieval. Testing on the topic distillation task of TREC 2003 and 2004, sub-site retrieval leads to significant improvement of retrieval performance over the previous methods based on single pages. Furthermore, time complexity analysis shows that sub-site retrieval can be integrated into the index component of search engines.