Amazon S3 for science grids: a viable solution?

Authors:
Mayur R. Palankar;Adriana Iamnitchi;Matei Ripeanu;Simson Garfinkel
Affiliations:
University of South Florida, Tampa, FL, USA;University of South Florida, Tampa, FL, USA;University of British Columbia, Vancouver, BC, Canada;Harvard University, Cambridge, MA, USA
Venue:
DADC '08 Proceedings of the 2008 international workshop on Data-aware distributed computing
Year:
2008

Citing 2
Cited 59

End-to-end routing behavior in the Internet

Conference proceedings on Applications, technologies, architectures, and protocols for computer communications
Architectural styles and the design of network-based software architectures

Architectural styles and the design of network-based software architectures

Scientific computing using virtual high-performance computing: a case study using the Amazon elastic computing cloud

Proceedings of the 2008 annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries: riding the wave of technology
A Financial Option Based Grid Resources Pricing Model: Towards an Equilibrium between Service Quality for User and Profitability for Service Providers

GPC '09 Proceedings of the 4th International Conference on Advances in Grid and Pervasive Computing
Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters

Proceedings of the 18th ACM international symposium on High performance distributed computing
Exploring data reliability tradeoffs in replicated storage systems

Proceedings of the 18th ACM international symposium on High performance distributed computing
C-Meter: A Framework for Performance Analysis of Computing Clouds

CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
In cloud, do MTC or HTC service providers benefit from the economies of scale?

Proceedings of the 2nd Workshop on Many-Task Computing on Grids and Supercomputers
VGrADS: enabling e-Science workflows on grids and clouds with fault tolerance

Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
Integrating Cloud-Computing-Specific Model into Aircraft Design

CloudCom '09 Proceedings of the 1st International Conference on Cloud Computing
Balls into bins with related random choices

Proceedings of the twenty-second annual ACM symposium on Parallelism in algorithms and architectures
The impact of virtualization on the performance of Massively Multiplayer Online Games

Proceedings of the 8th Annual Workshop on Network and Systems Support for Games
A cost-benefit analysis of using cloud computing to extend the capacity of clusters

Cluster Computing
TrustStore: Making Amazon S3 Trustworthy with Services Composition

CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
Dynamic Load-Balanced Multicast for Data-Intensive Applications on Clouds

CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
Early observations on the performance of Windows Azure

Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Reshaping text data for efficient processing on Amazon EC2

Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Distributed systems meet economics: pricing in the cloud

HotCloud'10 Proceedings of the 2nd USENIX conference on Hot topics in cloud computing
CloudEdge: a content delivery system for storage service in cloud environment

International Journal of Ad Hoc and Ubiquitous Computing
The impact of virtualisation on the performance and operational costs of Massively Multiplayer Online Games

International Journal of Advanced Media and Communication
CAMEO: continuous analytics for massively multiplayer online games on cloud resources

Euro-Par'09 Proceedings of the 2009 international conference on Parallel processing
Middleware enabled data sharing on cloud storage services

Proceedings of the 5th International Workshop on Middleware for Service Oriented Computing
Application migration to cloud: a taxonomy of critical factors

Proceedings of the 2nd International Workshop on Software Engineering for Cloud Computing
Cumulus: an open source storage cloud for science

Proceedings of the 2nd international workshop on Scientific cloud computing
An automated approach to cloud storage service selection

Proceedings of the 2nd international workshop on Scientific cloud computing
Magellan: experiences from a science cloud

Proceedings of the 2nd international workshop on Scientific cloud computing
SimSaaS: simulation software-as-a-service

Proceedings of the 44th Annual Simulation Symposium
Cloud versus in-house cluster: evaluating Amazon cluster compute instances for running MPI applications

State of the Practice Reports
I/O performance of virtualized cloud environments

Proceedings of the second international workshop on Data intensive computing in the clouds
vfcBOX: multi-user consistent file sharing

Proceedings of the 9th International Workshop on Middleware for Grids, Clouds and e-Science
One optimized I/O configuration per HPC application: leveraging the configurability of cloud

Proceedings of the Second Asia-Pacific Workshop on Systems
Balls into bins with related random choices

Journal of Parallel and Distributed Computing
MATE-EC2: a middleware for processing data with AWS

Proceedings of the 2011 ACM international workshop on Many task computing on grids and supercomputers
A performance evaluation of Azure and Nimbus clouds for scientific applications

Proceedings of the 2nd International Workshop on Cloud Computing Platforms
An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2

Journal of Grid Computing
Saga: a cost efficient file system based on cloud storage service

GECON'11 Proceedings of the 8th international conference on Economics of Grids, Clouds, Systems, and Services
Developing a cost-effective virtual cluster on the cloud

GECON'11 Proceedings of the 8th international conference on Economics of Grids, Clouds, Systems, and Services
A privacy preserving authorisation system for the cloud

Journal of Computer and System Sciences
SpeQuloS: a QoS service for BoT applications using best effort distributed computing infrastructures

Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing
Time and Cost Sensitive Data-Intensive Computing on Hybrid Clouds

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Interactive Use of Cloud Services: Amazon SQS and S3

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Exploiting hardware heterogeneity within the same instance type of Amazon EC2

HotCloud'12 Proceedings of the 4th USENIX conference on Hot Topics in Cloud Ccomputing
Failure-aware resource provisioning for hybrid Cloud infrastructure

Journal of Parallel and Distributed Computing
A cost-effective cloud computing framework for accelerating multimedia communication simulations

Journal of Parallel and Distributed Computing
Evaluating Interconnect and Virtualization Performance forHigh Performance Computing

ACM SIGMETRICS Performance Evaluation Review
Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds

Future Generation Computer Systems
Juno: A Middleware Platform for Supporting Delivery-Centric Applications

ACM Transactions on Internet Technology (TOIT)
Cloud MapReduce for Monte Carlo bootstrap applied to Metabolic Flux Analysis

Future Generation Computer Systems
On a Catalogue of Metrics for Evaluating Commercial Cloud Services

GRID '12 Proceedings of the 2012 ACM/IEEE 13th International Conference on Grid Computing
P4-simsaas: policy specification for Multi-Tendency simulation software-as-a-service model

Proceedings of the Winter Simulation Conference
Enhancing performance of failure-prone clusters by adaptive provisioning of cloud resources

The Journal of Supercomputing
A Decision Table for the Cloud Computing Decision in Small Business

Information Resources Management Journal
Cloud storage pricing: a comparison of current practices

Proceedings of the 2013 international workshop on Hot topics in cloud services
Configurable performance analysis and evaluation framework for cloud systems

International Journal of Information and Communication Technology
Autonomous massively multiplayer online game operation on unreliable resources

Proceedings of the International C* Conference on Computer Science and Software Engineering
DynamicCloudSim: simulating heterogeneity in computational clouds

Proceedings of the 2nd ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies
SAMEVED: A System Architecture for Managing and Establishing Virtual Elastic Datacenters

International Journal of Grid and High Performance Computing
A framework for analyzing monetary cost of database systems in the cloud

WAIM'13 Proceedings of the 14th international conference on Web-Age Information Management
The sharing architecture: sub-core configurability for IaaS clouds

Proceedings of the 19th international conference on Architectural support for programming languages and operating systems
Analysis of I/O Performance on an Amazon EC2 Cluster Compute and High I/O Platform

Journal of Grid Computing
SpeQuloS: a QoS service for hybrid and elastic computing infrastructures

Cluster Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Amazon.com has introduced the Simple Storage Service (S3), a commodity-priced storage utility. S3 aims to provide storage as a low-cost, highly available service, with a simple 'pay-as-you-go' charging model. This article makes three contributions. First, we evaluate S3's ability to provide storage support to large-scale science projects from a cost, availability, and performance perspective. Second, we identify a set of additional functionalities that storage services targeting data-intensive science applications should support. Third, we propose unbundling the success metrics for storage utility performance as a solution, to reduce storage costs.