The LIVE-project: retrieval experiments based on evaluation viewpoints

  • Authors:
  • P. Bollmann;F. Jochum;U. Reiner;V. Weissmann;H. Zuse

  • Affiliations:
  • Technische Universitaet, Berlin;Technische Universitaet, Berlin;Technische Universitaet, Berlin;Technische Universitaet, Berlin;Technische Universitaet, Berlin

  • Venue:
  • SIGIR '85 Proceedings of the 8th annual international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 1985

Quantified Score

Hi-index 0.00

Visualization

Abstract

Besides the operators 'and', 'or' and 'not' the GRIPS retrieval language contains thesaurus — operators to extend the query and truncation — and context-operators for freetext and Boolean searching. In a similar way several other viewpoints and evaluation measures were defined and applied in the retrieval experiment. Under the assumption that the evaluation measure is an interval scale averaging is done by calculating the arithmetic mean.As levels of the experimental factor /8/ the following similarity measures were used: inner product measure, cosine measure, overlap measure, coefficient of Jaccard and Euclidean distance. As situative factors /8/ the number of documents retrieved by GRIPS, the number of descriptiors of the queries, generality and topic of documents were used.The retrieval experiment is not yet finished completely but several results have already been obtained. For example in the average (over 81 queries) for the above defined viewpoint the ranking with the inner product measure does not indicate a significant improvement compared with the GRIPS-output. In the case of the Euclidean distance measure it seems that in the average the user has to inspect less nonrelevant documents. This means an improvement compared with the unordered retrieved set from the GRIPS-output.For more details of the so called 'two-level retrieval process' and further experimental results we refer to the long version of this paper.