A data generator for cloud-scale benchmarking

  • Authors:
  • Tilmann Rabl;Michael Frank;Hatem Mousselly Sergieh;Harald Kosch

  • Affiliations:
  • Information Systems, University of Passau, Germany;Information Systems, University of Passau, Germany;Information Systems, University of Passau, Germany;Information Systems, University of Passau, Germany

  • Venue:
  • TPCTC'10 Proceedings of the Second TPC technology conference on Performance evaluation, measurement and characterization of complex systems
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In many fields of research and business data sizes are breaking the petabyte barrier. This imposes new problems and research possibilities for the database community. Usually, data of this size is stored in large clusters or clouds. Although clouds have become very popular in recent years, there is only little work on benchmarking cloud applications. In this paper we present a data generator for cloud sized applications. Its architecture makes the data generator easy to extend and to configure. A key feature is the high degree of parallelism that allows linear scaling for arbitrary numbers of nodes. We show how distributions, relationships and dependencies in data can be computed in parallel with linear speed up.