Improving web search relevance with semantic features

  • Authors:
  • Yumao Lu;Fuchun Peng;Gilad Mishne;Xing Wei;Benoit Dumoulin

  • Affiliations:
  • Yahoo! Inc., Sunnyvale, CA;Yahoo! Inc., Sunnyvale, CA;Yahoo! Inc., Sunnyvale, CA;Yahoo! Inc., Sunnyvale, CA;Yahoo! Inc., Sunnyvale, CA

  • Venue:
  • EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 2 - Volume 2
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Most existing information retrieval (IR) systems do not take much advantage of natural language processing (NLP) techniques due to the complexity and limited observed effectiveness of applying NLP to IR. In this paper, we demonstrate that substantial gains can be obtained over a strong baseline using NLP techniques, if properly handled. We propose a framework for deriving semantic text matching features from named entities identified in Web queries; we then utilize these features in a supervised machine-learned ranking approach, applying a set of emerging machine learning techniques. Our approach is especially useful for queries that contain multiple types of concepts. Comparing to a major commercial Web search engine, we observe a substantial 4% DCG5 gain over the affected queries.