New Balanced Data Allocating and Online Migrating Algorithms in Database Cluster

Authors:
Weihua Gong;Lianghuai Yang;Decai Huang;Lijun Chen
Affiliations:
College of Information Engineering, Zhejiang University of Technology, Hangzhou, China 310014;College of Information Engineering, Zhejiang University of Technology, Hangzhou, China 310014;College of Information Engineering, Zhejiang University of Technology, Hangzhou, China 310014;School of Electronics Engineering and Computer Science, Peking University, Beijing, China 100871
Venue:
APWeb/WAIM '09 Proceedings of the Joint International Conferences on Advances in Data and Web Management
Year:
2009

Citing 9
Cited 0

Parallel database systems: the future of high performance database systems

Communications of the ACM
Load balancing algorithms for parallel database processing on shared memory multiprocessors

PDIS '91 Proceedings of the first international conference on Parallel and distributed information systems
Distributed processing of very large datasets with DataCutter

Parallel Computing - Clusters and computational grids for scientific computing
Analysis of Dynamic Load Balancing Strategies for Parallel Shared Nothing Database Systems

VLDB '93 Proceedings of the 19th International Conference on Very Large Data Bases
Data partitioning and load balancing in parallel disk systems

The VLDB Journal — The International Journal on Very Large Data Bases
Data Allocation and Load Balancing for Heterogeneous Cluster Storage Systems

CCGRID '03 Proceedings of the 3st International Symposium on Cluster Computing and the Grid
Approaches to Balancing Data Load of Shared-Nothing Clusters and Their Performance Comparison

ICPADS '02 Proceedings of the 9th International Conference on Parallel and Distributed Systems
Supporting Load Balancing and Efficient Reorganization During System Scaling

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
A high-performance computing method for data allocation in distributed database systems

The Journal of Supercomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

An improved range data distribution method is proposed, which is suitable for both the homogeneous and heterogeneous database cluster with consideration of full use of different computing resources of nodes. In order to avoid the problem of load imbalance caused by the hot accessing, an online migrating algorithm is presented during the parallel processing. The experimental results show that the improved range partition method and the rebalancing strategy of online migrating algorithm not only significantly improve the throughput of database cluster but also keep the balanced state well. At the same time, the cluster system has achieved better scalability.