The data partition strategy based on hybrid range consistent hash in NoSQL database

Authors:
Zhikun Chen;Lumin Zhang;Shuqiang Yang;Shuang Tan;Li He;Ge Zhang;Huiyu Yang
Affiliations:
National University of Defense Technology, Changsha, P.R. China;National University of Defense Technology, Changsha, P.R. China;National University of Defense Technology, Changsha, P.R. China;National University of Defense Technology, Changsha, P.R. China;National University of Defense Technology, Changsha, P.R. China;Beijing Aeronautics Engineering Technology Research Center, Beijing, P.R. China;Beijing Aeronautics Engineering Technology Research Center, Beijing, P.R. China
Venue:
Proceedings of the Fifth International Conference on Internet Multimedia Computing and Service
Year:
2013

Citing 10
Cited 0

Consistent hashing and random trees: distributed caching protocols for relieving hot spots on the World Wide Web

STOC '97 Proceedings of the twenty-ninth annual ACM symposium on Theory of computing
Hybrid-Range Partitioning Strategy: A New Declustering Strategy for Multiprocessor Database Machines

VLDB '90 Proceedings of the 16th International Conference on Very Large Data Bases
Dynamo: amazon's highly available key-value store

Proceedings of twenty-first ACM SIGOPS symposium on Operating systems principles
Community Training: Partitioning Schemes in Good Shape for Federated Data Grids

E-SCIENCE '07 Proceedings of the Third IEEE International Conference on e-Science and Grid Computing
Bigtable: A Distributed Storage System for Structured Data

ACM Transactions on Computer Systems (TOCS)
PNUTS: Yahoo!'s hosted data serving platform

Proceedings of the VLDB Endowment
Cassandra: a structured storage system on a P2P network

Proceedings of the twenty-first annual symposium on Parallelism in algorithms and architectures
Benchmarking cloud serving systems with YCSB

Proceedings of the 1st ACM symposium on Cloud computing
MD-HBase: A Scalable Multi-dimensional Data Infrastructure for Location Aware Services

MDM '11 Proceedings of the 2011 IEEE 12th International Conference on Mobile Data Management - Volume 01
Advanced partitioning techniques for massively distributed computation

SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data

Quantified Score

Hi-index	0.00

Visualization

Abstract

With the development of Internet technology and Cloud Computing, more and more applications have to be confronted with the challenges of big data. NoSQL Database is fit to the management of big data because of the characteristics of high scalability, high availability and high fault-tolerance. The data partitioning strategy plays an important role in the NoSQL database. The existing data partitioning strategies will cause some problems such as low scalability, hot spot and low performance and so on. In this paper we proposed a new data partitioning strategy---HRCH, which can partitioning the data in a reasonable way. At last we use some experiments to verify the effectiveness of HRCH. It shows that the HRCH can improve the scalability of the system. It also can avoid the hot spot problem as far as possible. And it also can improve the parallel degree of processing to improve the system's performance in some processing.