An entropy-based interpretation of retrieval status value-based retrieval, and its application to the computation of term and query discrimination value: Research Articles

Authors:
Sándor Dominich;Júlia Góth;Tamás Kiezer;Zoltán Szlávik
Affiliations:
Department of Computer Science, University of Veszprém, Egyetem u. 10, 8200 Veszprém, Hungary;Department of Computer Science, University of Veszprém, Egyetem u. 10, 8200 Veszprém, Hungary;Department of Computer Science, University of Veszprém, Egyetem u. 10, 8200 Veszprém, Hungary;Department of Computer Science, University of Veszprém, Egyetem u. 10, 8200 Veszprém, Hungary
Venue:
Journal of the American Society for Information Science and Technology
Year:
2004

Citing 0
Cited 3

Production and use of information. Characterization of informetric distributions using effort function and density function exponential informetric process

Information Processing and Management: an International Journal - Special issue: Infometrics
Hierarchical-Hyperspherical Divisive Fuzzy C-Means (H2D-FCM) Clustering for Information Retrieval

WI-IAT '09 Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 01
Production and use of information. Characterization of informetric distributions using effort function and density function

Information Processing and Management: an International Journal - Special issue: Infometrics

Quantified Score

Hi-index	0.00

Visualization

Abstract

The concepts of Shannon information and entropy have been applied to a number of information retrieval tasks such as to formalize the probabilistic model, to design practical retrieval systems, to cluster documents, and to model texture in image retrieval. In this report, the concept of entropy is used for a different purpose. It is shown that any positive Retrieval Status Value (RSV)-based retrieval system may be conceived as a special probability space in which the amount of the associated Shannon information is being reduced; in this view, the retrieval system is referred to as Uncertainty Decreasing Operation (UDO). The concept of UDO is then proposed as a theoretical background for term and query discrimination power, and it is applied to the computation of term and query discrimination values in the vector space retrieval model. Experimental evidence is given as regards such computation; the results obtained compare well to those obtained using vector-based calculation of term discrimination values. The UDO-based computation, however, presents advantages over the vector-based calculation: It is faster, easier to assess and handle in practice, and its application is not restricted to the vector space model. Based on the ADI test collection, it is shown that the UDO-based Term Discrimination Value (TDV) weighting scheme yields better retrieval effectiveness than using the vector-based TDV weighting scheme. Also, experimental evidence is given to the intuition that the choice of an appropriate weighting scheme and similarity measure depends on collection properties, and thus the UDO approach may be used as a theoretical basis for this intuition. © 2005 Wiley Periodicals, Inc.