Multiple-Phase Collective I/O Technique for Improving Data Access Locality

  • Authors:

  • David E. Singh;Florin Isaila;Alejandro Calderon;Felix Garcia;Jesus Carretero

  • Affiliations:

  • Carlos III University of Madrid, Spain;Carlos III University of Madrid, Spain;Carlos III University of Madrid, Spain;Carlos III University of Madrid, Spain;Carlos III University of Madrid, Spain

  • Venue:
  • PDP '07 Proceedings of the 15th Euromicro International Conference on Parallel, Distributed and Network-Based Processing
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents Multiple-Phase Collective I/O, a novel collective I/O technique for distributed memory multi-processors. Multiple-Phase Collective I/O is a refinement of two-phase collective I/O technique. The communication phase is structured into several steps, which progressively increase the locality of the data to be written to a file system. Besides the description ofMultiple-Phase Collective I/O, our paper addresses two additional objectives. First, we target to improve the efficiency of the Sulphur Transport Eurelian Model 2 (STEM-II) application. STEM-II is an air quality model that simulates transport, chemical transformations, emission and deposition processes in a unified framework. Due to the large amount of processed data, I/O becomes a critical factor for the application performance. Multiple-Phase Collective I/O, considerably enhances the performance of the I/O stage in particular and, consequently, of the whole application in general. Second objective consists of evaluating and comparing the performance of Multiple-Phase Collective I/O with that of other well known parallel I/O techniques.