A (condensed) parametric study of optimistic computation in wide-area, distributed environments

Authors:
Craig A. Lee;Nikos Chrisochoides
Affiliations:
The Aerospace Corporation, El Segundo, CA;College of William and Mary, Williamsburg, VA
Venue:
Proceedings of the 15th ACM Mardi Gras conference: From lightweight mash-ups to lambda grids: Understanding the spectrum of distributed computing requirements, applications, tools, infrastructures, interoperability, and the incremental adoption of key capabilities
Year:
2008

Citing 14
Cited 0

Virtual time

ACM Transactions on Programming Languages and Systems (TOPLAS)
Parallel discrete event simulation

Communications of the ACM - Special issue on simulation
Optimistic Make (Software Design)

IEEE Transactions on Computers
Optimistic active messages: a mechanism for scheduling communication with computation

PPOPP '95 Proceedings of the fifth ACM SIGPLAN symposium on Principles and practice of parallel programming
Global Virtual Time and distributed synchronization

PADS '95 Proceedings of the ninth workshop on Parallel and distributed simulation
Dummynet: a simple approach to the evaluation of network protocols

ACM SIGCOMM Computer Communication Review
Effective fine-grain synchronization for automatically parallelized programs using optimistic synchronization primitives

ACM Transactions on Computer Systems (TOCS)
Supporting efficient execution in heterogeneous distributed computing environments with cactus and globus

Proceedings of the 2001 ACM/IEEE conference on Supercomputing
A wait-free algorithm for optimistic programming: HOPE realized

ICDCS '96 Proceedings of the 16th International Conference on Distributed Computing Systems (ICDCS '96)
Mesh generation and optimistic computation on the grid

Performance analysis and grid computing
An integrated experimental environment for distributed systems and networks

OSDI '02 Proceedings of the 5th symposium on Operating systems design and implementationCopyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading
The WarpIV Simulation Kernel

Proceedings of the 19th Workshop on Principles of Advanced and Distributed Simulation
Cluster scheduling for explicitly-speculative tasks

Cluster scheduling for explicitly-speculative tasks
Optimistic Simulations of Physical Systems Using Reverse Computation

Simulation

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper explores the use of optimistic computation to improve application performance in wide-area distributed environments. We do so by defining a parametric model of optimistic computation and then running sets of parameterized experiments to show where, and to what degree, optimistic computation can produce speed-ups. The model is instantiated as an optimistic workload generator implemented as a parallel MPI code. Sets of experiments are then run using this code on an EmuLab system where the network topology, bandwidth and latency can be experimentally controlled. Hence, the results we obtain are from a real parallel code running over a real network protocol through emulated network conditions. We show that under favorable conditions, many fold speed-ups are possible, and even under moderate conditions, speed-ups can still be realized. While generally optimism provides the best speed-ups when network latency dominates the processing cycle, we have seen cases (with a 90% probability of success) when latency is only 1/6 of the processing cycle yet produces break-even relative performance and 85% of "local" performance. The ultimate goal is to apply this understanding to real-world grid applications that can use optimism to tolerate higher latencies.