Learning to cluster web search results

  • Authors:
  • Hua-Jun Zeng;Qi-Cai He;Zheng Chen;Wei-Ying Ma;Jinwen Ma

  • Affiliations:
  • Microsoft Research, Asia, Beijing, P.R. China;Peking University, Beijing, P. R. China;Microsoft Research, Asia, Beijing, P.R. China;Microsoft Research, Asia, Beijing, P.R. China;Peking University, Beijing, P. R. China

  • Venue:
  • Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Organizing Web search results into clusters facilitates users' quick browsing through search results. Traditional clustering techniques are inadequate since they don't generate clusters with highly readable names. In this paper, we reformalize the clustering problem as a salient phrase ranking problem. Given a query and the ranked list of documents (typically a list of titles and snippets) returned by a certain Web search engine, our method first extracts and ranks salient phrases as candidate cluster names, based on a regression model learned from human labeled training data. The documents are assigned to relevant salient phrases to form candidate clusters, and the final clusters are generated by merging these candidate clusters. Experimental results verify our method's feasibility and effectiveness.