Master–Worker: An Enabling Framework for Applications on the Computational Grid

Authors:
Jean-Pierre Goux;Sanjeev Kulkarni;Michael Yoder;Jeff Linderoth
Affiliations:
Department of Electrical and Computer Engineering, Northwestern University, Mathematics and Computer Science Division, Argonne National Laboratory, 9700 South Cass Avenue Argonne, IL 60439, USA;Computer Sciences Department, University of Wisconsin – Madison, 1210 West Dayton Street, Madison, WI 53706, USA;Computer Sciences Department, University of Wisconsin – Madison, 1210 West Dayton Street, Madison, WI 53706, USA;Mathematics and Computer Science Division, Argonne National Laboratory, 9700 South Cass Avenue, Argonne, IL 60439, USA
Venue:
Cluster Computing
Year:
2001

Citing 15
Cited 12

Supercomputing out of recycled garbage: preliminary experience with Piranha

ICS '92 Proceedings of the 6th international conference on Supercomputing
A worldwide flock of Condors: load sharing among workstation clusters

Future Generation Computer Systems - Special issue: resource management in distributed systems
Interfacing Condor and PVM to harness the cycles of workstation clusters

Future Generation Computer Systems - Special issue: resource management in distributed systems
The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
High-throughput resource management

The grid
Running EveryWare on the computational grid

SC '99 Proceedings of the 1999 ACM/IEEE conference on Supercomputing
Charlotte: metacomputing on the Web

Future Generation Computer Systems - Special issue on metacomputing
Scalable networked information processing environment (SNIPE)

Future Generation Computer Systems - Special issue on metacomputing
Bayanihan: building and studying web-based volunteer computing systems using Java

Future Generation Computer Systems - Special issue on metacomputing
The network weather service: a distributed resource performance forecasting service for metacomputing

Future Generation Computer Systems - Special issue on metacomputing
Globe: A Wide-Area Distributed System

IEEE Concurrency
Applying NetSolve's Network-Enabled Server

IEEE Computational Science & Engineering
Nimrod: a tool for performing parametrised simulations using distributed workstations

HPDC '95 Proceedings of the 4th IEEE International Symposium on High Performance Distributed Computing
Legion: An Operating System for Wide-Area Computing

Legion: An Operating System for Wide-Area Computing
The Wiener maximum quadratic assignment problem

Discrete Optimization

Decomposition Algorithms for Stochastic Programming on a Computational Grid

Computational Optimization and Applications
Biological sequence alignment on the computational grid using the GrADS framework

Future Generation Computer Systems - Special section: Complex problem-solving environments for grid computing
A grid-enabled distributed branch-and-bound algorithm with application on the Steiner problem in graphs

Parallel Computing - Optimization on grids - Optimization for grids
Solving simulation optimization problems on grid computing systems

Parallel Computing - Optimization on grids - Optimization for grids
PaRS: fast and near-optimal grid-based cell sizing for library-based design

Proceedings of the 2008 IEEE/ACM International Conference on Computer-Aided Design
Grid enabled MRP process improvement under distributed database environment

Journal of Systems and Software
Improving Bounds on the Football Pool Problem by Integer Programming and High-Throughput Computing

INFORMS Journal on Computing
Biological sequence alignment on the computational grid using the GrADS framework

Future Generation Computer Systems - Special section: Complex problem-solving environments for grid computing
PaRS: parallel and near-optimal grid-based cell sizing for library-based design

IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems
On the evaluation of gridification effort and runtime aspects of JGRIM applications

Future Generation Computer Systems
ServiceBSP model with qos considerations in grids

APWeb'06 Proceedings of the 2006 international conference on Advanced Web and Network Technologies, and Applications
Time-constrained high-fidelity rendering on local desktop grids

EG PGV'09 Proceedings of the 9th Eurographics conference on Parallel Graphics and Visualization

Quantified Score

Hi-index	0.00

Visualization

Abstract

The goal of this work is to create a tool that allows users to easily distribute large scientific computations on computational grids. Our tool MW relies on the simple master–worker paradigm. MW provides both a top Level interface to application software and a bottom Level interface to existing Grid computing toolkits. Both interfaces are briefly described. We conclude with a case study, where the necessary Grid services are provided by the Condor high-throughput computing system, and the MW-enabled application code is used to solve a combinatorial optimization problem of unprecedented complexity.