Parallel I/O scheduling using randomized, distributed edge coloring algorithms

  • Authors:
  • Dannie Durand;Ravi Jain;David Tseytlin

  • Affiliations:
  • Department of Biological Sciences, Carnegie Mellon University, 4400 Fifth Avenue, Pittsburgh, PA and Applied Research, Telcordia Technologies, 445 South Street, Morristown, NJ;DoCoMo USA Labs, 181 Metro Dr., San Jose, CA and Applied Research Telcordia Technologies, 445 South Street, Morristown, NJ;Applied Research Telcordia Technologies, 445 South Street, Morristown, NJ

  • Venue:
  • Journal of Parallel and Distributed Computing
  • Year:
  • 2003

Quantified Score

Hi-index 0.01

Visualization

Abstract

A growing imbalance in CPU and I/O speeds has led to a communications bottleneck in distributed architectures, especially for data-intensive applications such as multimedia information systems, databases, and Grand Challenge problems. Our solution is to schedule parallel I/O operations explicitly. We present a class of decentralized scheduling algorithms that eliminate contention for I/O ports while maintaining an efficient use of bandwidth. These algorithms, based on edge-coloring and matching of bipartite graphs, rely upon simple heuristics to obtain shorter schedules. We use simulation to evaluate the ability of our algorithms to obtain near optimal solutions in a distributed context, and compare our work with that of other researchers. Our results show that our algorithms produce schedules within 5% of the optimal schedule, a substantial improvement over existing algorithms.