An evaluation of evolved term-weighting schemes in information retrieval

Authors:
Ronan Cummins;Colm O'Riordan
Affiliations:
National University of Ireland, Galway, Ireland;National University of Ireland, Galway, Ireland
Venue:
Proceedings of the 14th ACM international conference on Information and knowledge management
Year:
2005

Citing 3
Cited 1

Genetic programming: on the programming of computers by means of natural selection

Genetic programming: on the programming of computers by means of natural selection
Word document density and relevance scoring (poster session)

SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
Learning to Rank

Information Retrieval

An axiomatic comparison of learned term-weighting schemes in information retrieval: clarifications and extensions

Artificial Intelligence Review

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents an evaluation of evolved term-weighting schemes on short, medium and long TREC queries. A previously evolved global (collection-wide) term-weighting scheme is evaluated on unseen TREC data and is shown to increase mean average precision over idf. A local (within-document) evolved term-weighting scheme is presented which is dependent on the best performing global scheme. The full evolved scheme (i.e. the combined local and global scheme) is compared to both the BM25 scheme and the Pivoted Normalisation scheme.Our results show that the local evolved solution does not perform well on some collections due to its document normalisation properties and we conclude that Okapi-tf can be tuned to interact effectively with the evolved global weighting scheme presented and increase mean average precision over the standard BM25 scheme.