TSS: Efficient Term Set Search in Large Peer-to-Peer Textual Collections

  • Authors:
  • Hanhua Chen;Jun Yan;Hai Jin;Yunhao Liu;Lionel M. Ni

  • Affiliations:
  • Huazhong University of Science and Technology, China;Microsoft Research Asia;Huazhong University of Science and Technology, China;Hong Kong University of Science and Technology;Hong Kong University of Science and Technology

  • Venue:
  • IEEE Transactions on Computers
  • Year:
  • 2010

Quantified Score

Hi-index 14.98

Visualization

Abstract

Previous multikeyword search in DHT-based P2P systems often relies on multiple single keyword search operations, suffering from unacceptable traffic cost and poor accuracy. Precomputing term-set-based index can significantly reduce the cost but needs exponentially growing index size. Based on our observations that 1) queries are typically short and 2) users usually have limited interests, we propose a novel index pruning method, called TSS. By solely publishing the most relevant term sets from documents on the peers, TSS provides comparable search performance with a centralized solution, while the index size is reduced from exponential to the scale of O(nlog(n)). We evaluate this design through comprehensive trace-driven simulations using the TREC WT10G data collection and the query log of a major commercial search engine.