A reliable storage management layer for distributed information retrieval systems

Authors:
Charles L. A. Clarke;Philip L. Tilker;Allen Quoc-Luan Tran;Kevin Harris;Antonio S. Cheng
Affiliations:
University of Waterloo, Waterloo, Ontario, Canada;University of Waterloo, Waterloo, Ontario, Canada;University of Toronto, Toronto, Ontario, Canada;University of Toronto, Toronto, Ontario, Canada;University of Toronto, Toronto, Ontario, Canada
Venue:
CIKM '03 Proceedings of the twelfth international conference on Information and knowledge management
Year:
2003

Citing 18
Cited 2

Concurrency control and recovery in database systems

Concurrency control and recovery in database systems
Optimization for dynamic inverted index maintenance

SIGIR '90 Proceedings of the 13th annual international ACM SIGIR conference on Research and development in information retrieval
RAID: high-performance, reliable secondary storage

ACM Computing Surveys (CSUR)
Incremental updates of inverted lists for text document retrieval

SIGMOD '94 Proceedings of the 1994 ACM SIGMOD international conference on Management of data
Efficient transaction support for dynamic information retrieval systems

SIGIR '96 Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval
Performance issues in distributed shared-nothing information-retrieval systems

Information Processing and Management: an International Journal
Cluster-based scalable network services

Proceedings of the sixteenth ACM symposium on Operating systems principles
Archival storage for digital libraries

Proceedings of the third ACM conference on Digital libraries
Query performance for tightly coupled distributed digital libraries

Proceedings of the third ACM conference on Digital libraries
Efficient distributed algorithms to build inverted files

Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Passage-based query refinement (MultiText experiments for TREC-6)

Information Processing and Management: an International Journal - The sixth text REtrieval conference (TREC-6)
The impact of database selection on distributed searching

SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
Distributed Algorithms

Distributed Algorithms
Replication Techniques in Distributed Systems

Replication Techniques in Distributed Systems
Indexing Techniques for Advanced Database Systems

Indexing Techniques for Advanced Database Systems
Fast Incremental Indexing for Full-Text Information Retrieval

VLDB '94 Proceedings of the 20th International Conference on Very Large Data Bases
Partial Collection Replication for Information Retrieval

Information Retrieval
SRIRAM: A scalable resilient autonomic mesh

IBM Systems Journal

Approximating the top-m passages in a parallel question answering system

Proceedings of the thirteenth ACM international conference on Information and knowledge management
A pipelined architecture for distributed text query evaluation

Information Retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a storage management layer that facilitates the implementation of parallel information retrieval systems, and related applications, on networks of workstations. The storage management layer automates the process of adding and removing nodes, and implements a dispersed mirroring strategy to improve reliability. When nodes are added and removed, the document collection managed by the system is redistributed for load balancing purposes. The use of dispersed mirroring minimizes the impact of node failures and system modifications on query performance.