Search and replication in unstructured peer-to-peer networks
ICS '02 Proceedings of the 16th international conference on Supercomputing
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
PlanetP: Using Gossiping to Build Content Addressable Peer-to-Peer Information Sharing Communities
HPDC '03 Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing
SETS: search enhanced by topic segmentation
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
PAST: A Large-Scale, Persistent Peer-to-Peer Storage Utility
HOTOS '01 Proceedings of the Eighth Workshop on Hot Topics in Operating Systems
Content-based retrieval in hybrid peer-to-peer networks
CIKM '03 Proceedings of the twelfth international conference on Information and knowledge management
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
A content model for evaluating peer-to-peer searching techniques
Proceedings of the 5th ACM/IFIP/USENIX international conference on Middleware
MINERVA: collaborative P2P search
VLDB '05 Proceedings of the 31st international conference on Very large data bases
The SMART Retrieval System—Experiments in Automatic Document Processing
The SMART Retrieval System—Experiments in Automatic Document Processing
A suite of testbeds for the realistic evaluation of peer-to-peer information retrieval systems
ECIR'05 Proceedings of the 27th European conference on Advances in Information Retrieval Research
Hi-index | 0.00 |
Peer-to-Peer (P2P) is an attractive paradigm for building distributed network applications. A particularly intriguing class of distributed applications consists in Information Retrieval (IR) systems. The issue of Peer-to-Peer Information Retrieval (P2PIR) is being tackled by researchers attempting to provide valuable insights and to propose solutions to use it successfully. Nearly, all published studies have been evaluated by simulation means, using well-known document collections (usually acquired from TREC). This practice leads to two problems: First, there is little justification in favour of the document distributions used by relevant studies and second, since different studies use different experimental benchmarks, there is no common ground for comparing the solutions proposed. In this paper, we propose Peer-to-Peer Information Retrieval Benchmarking (P2PIRB), a benchmarking framework for P2PIR. P2PIRB allows to distribute documents and queries according to various ways. This work marks the start of an effort to provide more realistic evaluation environments for P2PIR systems as well as to create a common ground to compare the current and future architectures.