Madre: the Memory-Aware Data Redistribution Engine

  • Authors:
  • Stephen F. Siegel;Andrew R. Siegel

  • Affiliations:
  • VERIFIED SOFTWARE LABORATORY, DEPARTMENT OF COMPUTERAND INFORMATION SCIENCES, UNIVERSITY OF DELAWARE, NEWARK, DE 19716, USA;MATHEMATICS AND COMPUTER SCIENCE DIVISION, ARGONNE NATIONALLABORATORY, 9700 SOUTH CASS AVENUE, ARGONNE, IL 60439, USA

  • Venue:
  • International Journal of High Performance Computing Applications
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We report on the development of a new computational framework for efficiently carrying out parallel data redistribution in a limited memory environment. This new library, MADRE (Memory-Aware Data Redistribution Engine), is an open-source, C/MPI-based toolkit designed for quick and easy integration into application codes that have demanding data migration needs. At the same time, MADRE exposes a lower-level application programming interface that greatly facilitates the development and incorporation of new algorithms into the MADRE framework, thus serving as a potential organizing entity for continued research in this area. Finally, we develop, describe, and test in detail several new parallel redistribution algorithms that are incorporated into the MADRE distribution.