Simulation-based analysis of performance dynamics of distributed applications in heterogeneous network environments

Authors:
Qishi Wu;Yi Gu;Zongmin Wang
Affiliations:
University of Memphis, Memphis, TN;University of Memphis, Memphis, TN;Zhengzhou University, Zhengzhou, China
Venue:
SpringSim '09 Proceedings of the 2009 Spring Simulation Multiconference
Year:
2009

Citing 10
Cited 2

NEST: a network simulation and prototyping testbed

Communications of the ACM - Special issue on simulation
Dynamic Critical-Path Scheduling: An Effective Technique for Allocating Task Graphs to Multiprocessors

IEEE Transactions on Parallel and Distributed Systems
MCI—multilanguage distributed co-simulation tool

DIPES '98 Proceedings of the IFIP WG10.3/WG10.5 international workshop on Distributed and parallel embedded systems
Advancing the Boundaries of High-Connectivity Network Simulation with Distributed Computing

Neural Computation
A distributed computing tool for generating neural simulation databases

Neural Computation
A Dynamic Critical Path Algorithm for Scheduling Scientific Workflow Applications on Global Grids

E-SCIENCE '07 Proceedings of the Third IEEE International Conference on e-Science and Grid Computing
Mapping pipeline skeletons onto heterogeneous platforms

Journal of Parallel and Distributed Computing
Efficient pipeline configuration in distributed heterogeneous computing environments

Proceedings of the twenty-seventh ACM symposium on Principles of distributed computing
Supporting Distributed Application Workflows in Heterogeneous Computing Environments

ICPADS '08 Proceedings of the 2008 14th IEEE International Conference on Parallel and Distributed Systems
Complexity Analysis of Pipeline Mapping Problems in Distributed Heterogeneous Networks

International Journal of Distributed Sensor Networks

Latency modeling and minimization for large-scale scientific workflows in distributed network environments

Proceedings of the 44th Annual Simulation Symposium
Modeling and simulation of distributed computing workflows in heterogeneous network environments

Simulation

Quantified Score

Hi-index	0.00

Visualization

Abstract

Next-generation computation-intensive collaborative applications in various science and engineering fields feature large-scale distributed computing workflows. There exist many distributed algorithms for task scheduling, module mapping, and service provisioning to support the execution of such workflows in heterogeneous computing environments and optimize their network performance for fast user interaction or smooth data flow. However, deploying large-scale distributed applications in real network environments is extremely challenging because of the time-varying dynamics in the reliability, availability, capacity, and capability of massively distributed system resources, which are typically shared among a broad community of users over Internet or dedicated connections. We propose a simulation system to study the execution dynamics of distributed applications and evaluate the network performance of scheduling or mapping solutions before real-life deployment and experimentation. The proposed system visually illustrates the dynamic execution process of complex workflows in network environments by simulating data communication over transport links and data processing on computer nodes in a highly distributed and parallel manner. We implement the simulation system and conduct extensive testings on various distributed mapping algorithms. The theoretical results obtained by rigorous performance analysis based on well-defined mathematical models are evidently confirmed by the simulation-based performance measurements.