A relative word-frequency based method for relevance feedback

  • Authors:
  • Zilong Chen;Yang Lu

  • Affiliations:
  • State Key Lab. of Software Development Environment, BeiHang University, Beijing, P.R. China;School of Software and Microelectronics, Peking University, Beijing, P.R. China

  • Venue:
  • AIMSA'10 Proceedings of the 14th international conference on Artificial intelligence: methodology, systems, and applications
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Traditional relevance feedback methods, which usually use the most frequent terms in the relevant documents as expansion terms to enrich the user's initial query, could help improve retrieval performance. However, in reality, many expansion terms identified in traditional approaches are indeed unrelated to the query and even harmful to the retrieval. This paper introduces a new method based on the relative word-frequency to select good expansion terms. The relative word-frequency defined in this paper is a new feature and can help discriminate relevant documents from irrelevant ones. The new approach selects good expansion terms according to the relative word-frequency and uses them to reformulate the initial query. We compare a set of existing relevance feedback methods with our proposed approach, including the representative vector space models and language models. Our experiments on several TREC collections demonstrate that retrieval effectiveness can be much improved when the proposed approach is used. Experimental results show that the improvement of our proposed approach is more than 30% over traditional relevance feedback techniques.