DIRAC: A Scalable Lightweight Architecture for High Throughput Computing

  • Authors:
  • Andrei Tsaregorodtsev;Vincent Garonne;Ian Stokes-Rees

  • Affiliations:
  • Centre de Physique des Particules de Marseille, France;Centre de Physique des Particules de Marseille, France;University of Oxford, UK

  • Venue:
  • GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

DIRAC (Distributed Infrastructure with Remote Agent Control) has been developed by the CERN LHCb physics experiment to facilitate large scale simulation and user analysis tasks spread across both grid and non-grid computing resources. It consists of a small set of distributed stateless Core Services, which are centrally managed, and Agents which are managed by each computing site. DIRAC utilizes concepts from existing distributed computing models to provide a lightweight, robust, and flexible system. This paper will discuss the architecture, performance, and implementation of the DIRAC system which has recently been used for an intensive physics simulation involving more than forty sites, 90 TB of data, and in excess of one thousand 1 GHz processor-years.