Scalable Grid-wide capacity allocation with the SweGrid Accounting System (SGAS)

Authors:
Peter Gardfjäll;Erik Elmroth;Lennart Johnsson;Olle Mulmo;Thomas Sandholm
Affiliations:
Department of Computing Science and HPC2N, Umeå University, SE-901 87 Umeå, Sweden;Department of Computing Science and HPC2N, Umeå University, SE-901 87 Umeå, Sweden;School of Computer Science and Communication, Royal Institute of Technology, SE-100 44 Stockholm, Sweden;School of Computer Science and Communication, Royal Institute of Technology, SE-100 44 Stockholm, Sweden;School of Computer Science and Communication, Royal Institute of Technology, SE-100 44 Stockholm, Sweden
Venue:
Concurrency and Computation: Practice & Experience
Year:
2008

Citing 0
Cited 5

RESERVOIR: management technologies and requirements for next generation service oriented infrastructures

IM'09 Proceedings of the 11th IFIP/IEEE international conference on Symposium on Integrated Network Management
Distributed usage logging for federated Grids

Future Generation Computer Systems
The reservoir model and architecture for open federated cloud computing

IBM Journal of Research and Development
GJMF - a composable service-oriented grid job management framework

Future Generation Computer Systems
DQMP: a decentralized protocol to enforce global quotas in cloud environments

SSS'12 Proceedings of the 14th international conference on Stabilization, Safety, and Security of Distributed Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

The SweGrid Accounting System (SGAS) allocates capacity in collaborative Grid environments by coordinating enforcement of Grid-wide usage limits as a means to offer usage guarantees and prevent overuse. SGAS employs a credit-based allocation model where Grid capacity is granted to projects via Grid-wide quota allowances that can be spent across the Grid resources. The resources collectively enforce these allowances in a soft, real-time manner. SGAS is built on service-oriented principles with a strong focus on interoperability and Web services standards. This article covers the SGAS design and implementation, which, besides addressing inherent Grid challenges (scale, security, heterogeneity, decentralization), emphasizes generality and flexibility to produce a customizable system with lightweight integration into different middleware and scheduling system combinations. We focus the discussion around the system design, a flexible allocation model, middleware integration experiences and scalability improvements via a distributed virtual banking system, and finally, an extensive set of testbed experiments. The experiments evaluate the performance of SGAS in terms of response times, request throughput, overall system scalability, and its performance impact on the Globus Toolkit 4 job submission software. We conclude that, for all practical purposes, the quota enforcement overhead incurred by SGAS on job submissions is not a limiting factor for the job-handling capacity of the job submission software. Copyright © 2008 John Wiley & Sons, Ltd.