Estimating resource costs of data-intensive workloads in public clouds

Authors:
Rizwan Mian;Patrick Martin;Farhana Zulkernine;Jose Luis Vazquez-Poletti
Affiliations:
Queen's University, Ontario, Canada;Queen's University, Ontario, Canada;Queen's University, Ontario, Canada;Universidad Complutense de Madrid, Madrid, Spain
Venue:
Proceedings of the 10th International Workshop on Middleware for Grids, Clouds and e-Science
Year:
2012

Citing 11
Cited 2

Benchmarking cloud serving systems with YCSB

Proceedings of the 1st ACM symposium on Cloud computing
A cost-benefit analysis of using cloud computing to extend the capacity of clusters

Cluster Computing
Runtime measurements in the cloud: observing, analyzing, and reducing variance

Proceedings of the VLDB Endowment
Flexible use of cloud resources through profit maximization and price discrimination

ICDE '11 Proceedings of the 2011 IEEE 27th International Conference on Data Engineering
A model for efficient onboard actualization of an instrumental cyclogram for the mars metnet mission on a public cloud infrastructure

PARA'10 Proceedings of the 10th international conference on Applied Parallel and Scientific Computing - Volume Part I
Time and Cost Sensitive Data-Intensive Computing on Hybrid Clouds

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Executing Data-Intensive Workloads in a Cloud

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Pricing and Resource Allocation in a Cloud Computing Market

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Pricing Cloud Compute Commodities: A Novel Financial Economic Model

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
A Cost-Effective Mechanism for Cloud Data Reliability Management Based on Proactive Replica Checking

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Provisioning data analytic workloads in a cloud

Future Generation Computer Systems

Toward software-defined SLAs

Communications of the ACM
Toward Software-defined SLAs

Queue - Distributed Computing

Quantified Score

Hi-index	0.02

Visualization

Abstract

The promise of "infinite" resources given by the cloud computing paradigm has led to recent interest in exploiting clouds for large-scale data-intensive computing. In this paper, we present a model to estimate the resource costs for executing data-intensive workloads in a public cloud. The cost model quantifies the cost-effectiveness of a resource configuration for a given workload with consumer performance requirements expressed as SLAs, and is a key component of a larger framework for resource provisioning in clouds. We instantiate the cost model for the Amazon cloud, and experimentally evaluate the impact of key factors on the accuracy of the model.