A correlation-aware data placement strategy for key-value stores

  • Authors:

  • Ricardo Vilaça;Rui Oliveira;José Pereira

  • Affiliations:

  • High-Assurance Software Laboratory, University of Minho, Braga, Portugal;High-Assurance Software Laboratory, University of Minho, Braga, Portugal;High-Assurance Software Laboratory, University of Minho, Braga, Portugal

  • Venue:
  • Proceedings of the 11th IFIP WG 6.1 international conference on Distributed applications and interoperable systems
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Key-value stores hold the unprecedented bulk of the data produced by applications such as social networks. Their scalability and availability requirements often outweigh sacrificing richer data and processing models, and even elementary data consistency. Moreover, existing key-value stores have only random or order based placement strategies. In this paper we exploit arbitrary data relations easily expressed by the application to foster data locality and improve the performance of complex queries common in social network read-intensive workloads. We present a novel data placement strategy, supporting dynamic tags, based on multidimensional locality-preserving mappings. We compare our data placement strategy with the ones used in existing key-value stores under the workload of a typical social network application and show that the proposed correlation-aware data placement strategy offers a major improvement on the system's overall response time and network requirements.