A bridging model for parallel computation
Communications of the ACM
Distributed Processing of Similarity Queries
Distributed and Parallel Databases
Near Neighbor Search in Large Metric Spaces
VLDB '95 Proceedings of the 21th International Conference on Very Large Data Bases
Novel architectures for P2P applications: the continuous-discrete approach
Proceedings of the fifteenth annual ACM symposium on Parallel algorithms and architectures
Efficient, Proximity-Aware Load Balancing for DHT-Based P2P Systems
IEEE Transactions on Parallel and Distributed Systems
A scheme for load balancing in heterogenous distributed hash tables
Proceedings of the twenty-fourth annual ACM symposium on Principles of distributed computing
A compact space decomposition for effective metric indexing
Pattern Recognition Letters
Load balancing for term-distributed parallel retrieval
SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Replica Placement and Location using Distributed Hash Tables
LCN '07 Proceedings of the 32nd IEEE Conference on Local Computer Networks
Peer-to-peer similarity search in metric spaces
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Adaptive Load Balancing for Lookups in Heterogeneous DHT
EUC '08 Proceedings of the 2008 IEEE/IFIP International Conference on Embedded and Ubiquitous Computing - Volume 02
Parallel query processing on distributed clustering indexes
Journal of Discrete Algorithms
A repartitioning hypergraph model for dynamic load balancing
Journal of Parallel and Distributed Computing
A Note on Online Scheduling for Jobs with Arbitrary Release Times
COCOA '09 Proceedings of the 3rd International Conference on Combinatorial Optimization and Applications
ROAR: increasing the flexibility and performance of distributed search
Proceedings of the ACM SIGCOMM 2009 conference on Data communication
Dynamic P2P Indexing and Search Based on Compact Clustering
SISAP '09 Proceedings of the 2009 Second International Workshop on Similarity Search and Applications
Scheduling Metric-Space Queries Processing on Multi-Core Processors
PDP '10 Proceedings of the 2010 18th Euromicro Conference on Parallel, Distributed and Network-based Processing
Efficient Peer-to-Peer Similarity Query Processing for High-dimensional Data
APWEB '10 Proceedings of the 2010 12th International Asia-Pacific Web Conference
Distributing a Metric-Space Search Index onto Processors
ICPP '10 Proceedings of the 2010 39th International Conference on Parallel Processing
kNN query processing in metric spaces using GPUs
Euro-Par'11 Proceedings of the 17th international conference on Parallel processing - Volume Part I
P2P-based multidimensional indexing methods: A survey
Journal of Systems and Software
Replication, load balancing and efficient range query processing in DHTs
EDBT'06 Proceedings of the 10th international conference on Advances in Database Technology
Outsourced Similarity Search on Metric Data Assets
IEEE Transactions on Knowledge and Data Engineering
| Hi-index | 0.00 |
Metric-space similarity search has been proven suitable for searching large collections of complex objects such as images. A number of distributed index data structures and respective parallel query processing algorithms have been proposed for clusters of distributed memory processors. Previous work has shown that best performance is achieved when using global indexing as opposed to local indexing. However global indexing is prone to performance degradation when query load becomes unbalanced across processors. This paper proposes a query scheduling algorithm that solves this problem. It adaptively load balances processing of user queries that are dynamically skewed towards particular sections of the distributed index. Sections highly hit by queries can be kept replicated. Experimental results show that with 1%-10% replication performance improves significantly (e.g., 35%) under skewed work-loads.