Evolving weighting functions for query expansion based on relevance feedback

  • Authors:
  • A. Borji;M. Z. Jahromi

  • Affiliations:
  • School of Cognitive Sciences, Institute for Studies in Theoretical Physics and Mathematics, Tehran, Iran;Department of Computer Science and Engineering, Shiraz University, Shiraz, Iran

  • Venue:
  • APWeb'08 Proceedings of the 10th Asia-Pacific web conference on Progress in WWW research and development
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

A new method for query expansion using genetic programming (GP) is proposed in this paper to enhance the retrieval performance of text information retrieval systems. Using a set of queries and retrieved relevant and nonrelevant documents corresponding to each query, GP tries to evolve a criteria for selecting terms which when added to the original query improve the next retrieved set of documents. Two experiments are conducted to evaluate the proposed method over three standard datasets: Cranfield, Lisa and Medline. In first experiment a formula is evolved using GP over a training set and is then evaluated over a test query set of the same dataset. In the second experiment, evolved expansion formula over a dataset is evaluated over a different dataset. We compared our method against the base probabilistic method in literature. Results show a higher performance in comparison with original and probabilistically expanded method.