Where the linked dependence assumption fails and how to move beyond it

  • Authors:
  • Bojidar Mateev;Elke Mittendorf;Peter Schäuble

  • Affiliations:
  • Institute for Operations Research, ETH Zentrum, Zurich;Institute for Information Systems, ETH Zentrum, Zurich;Institute for Information Systems, ETH Zentrum, Zurich

  • Venue:
  • IRSG'97 Proceedings of the 19th Annual BCS-IRSG conference on Information Retrieval Research
  • Year:
  • 1997

Quantified Score

Hi-index 0.00

Visualization

Abstract

The linked dependence assumption, a widely used simplification in probabilistic retrieval, is briefly reviewed and its validity is investigated. We show that the linked dependence assumption is violated particularly if the query features are good discriminators between relevant and non-relevant documents. We then propose the manual concept generation method, which takes into account the dependence between different query concepts. For a limited set of routing queries, experiments show a significant improvement when compared with retrieval methods which do not take into account feature dependencies. We consider this method to be the first successful step which progresses beyond the linked dependence assumption.