Some Formal Analysis of Roccio's Similarity-Based Relvance Feedback Algorithm

  • Authors:
  • Zhixiang Chen;Binhai Zhu

  • Affiliations:
  • -;-

  • Venue:
  • ISAAC '00 Proceedings of the 11th International Conference on Algorithms and Computation
  • Year:
  • 2000

Quantified Score

Hi-index 0.00

Visualization

Abstract

Rocchio's similarity-based Relevance feedback algorithm, one of the most important query reformation methods in information retrieval, is essentially an adaptive supervised learning algorithm from examples. In spite of its popularity in various applications there is little rigorous analysis of its learning complexity in literature. In this paper we show that in the Boolean vector space model, if the initial query vector is 0, then for any of the four typical similarities (inner product, dice coefficient, cosine coefficient, and Jaccard coefficient), Rocchio's similarity-based relevance feedback algorithm makes at least n mistakes when used to search for a collection of documents represented by a monotone disjunction of at most k relevant features (or terms) over the n-dimensional Boolean vector space {0, 1}n. When an arbitrary initial query vector in {0, 1}n is used, it makes at least (n + k -3)/2 mistakes to search for the same collection of documents. The linear lower bounds are independent of the choices of the threshold and coefficients that the algorithm may use in updating its query vector and making its classification.