Modeling the Score Distributions of Relevant and Non-relevant Documents

  • Authors:
  • Evangelos Kanoulas;Virgil Pavlu;Keshi Dai;Javed A. Aslam

  • Affiliations:
  • College of Computer and Information Science, Northeastern University, Boston, USA;College of Computer and Information Science, Northeastern University, Boston, USA;College of Computer and Information Science, Northeastern University, Boston, USA;College of Computer and Information Science, Northeastern University, Boston, USA

  • Venue:
  • ICTIR '09 Proceedings of the 2nd International Conference on Theory of Information Retrieval: Advances in Information Retrieval Theory
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Empirical modeling of the score distributions associated with retrieved documents is an essential task for many retrieval applications. In this work, we propose modeling the relevant documents' scores by a mixture of Gaussians and modeling the non-relevant scores by a Gamma distribution. Applying variational inference we automatically trade-off the goodness-of-fit with the complexity of the model. We test our model on traditional retrieval functions and actual search engines submitted to TREC. We demonstrate the utility of our model in inferring precision-recall curves. In all experiments our model outperforms the dominant exponential-Gaussian model.