Query weighting for ranking model adaptation

  • Authors:
  • Peng Cai;Wei Gao;Aoying Zhou;Kam-Fai Wong

  • Affiliations:
  • East China Normal University, Shanghai, China;The Chinese University of Hong Kong, Shatin, N. T., Hong Kong;East China Normal University, Shanghai, China;The Chinese University of Hong Kong, Shatin, N. T., Hong Kong and Key Laboratory of High Confidence Software Technologies, Ministry of Education, China

  • Venue:
  • HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
  • Year:
  • 2011

Quantified Score

Hi-index 0.01

Visualization

Abstract

We propose to directly measure the importance of queries in the source domain to the target domain where no rank labels of documents are available, which is referred to as query weighting. Query weighting is a key step in ranking model adaptation. As the learning object of ranking algorithms is divided by query instances, we argue that it's more reasonable to conduct importance weighting at query level than document level. We present two query weighting schemes. The first compresses the query into a query feature vector, which aggregates all document instances in the same query, and then conducts query weighting based on the query feature vector. This method can efficiently estimate query importance by compressing query data, but the potential risk is information loss resulted from the compression. The second measures the similarity between the source query and each target query, and then combines these fine-grained similarity values for its importance estimation. Adaptation experiments on LETOR3.0 data set demonstrate that query weighting significantly outperforms document instance weighting methods.