Modeling master/worker applications for automatic performance tuning

Authors:
E. Cesar;A. Moreno;J. Sorribes;E. Luque
Affiliations:
Autonomous University of Barcelona, Computer Architecture and Operating Systems, Edifici Q - Campus UAB, Barcelona, Spain;Autonomous University of Barcelona, Computer Architecture and Operating Systems, Edifici Q - Campus UAB, Barcelona, Spain;Autonomous University of Barcelona, Computer Architecture and Operating Systems, Edifici Q - Campus UAB, Barcelona, Spain;Autonomous University of Barcelona, Computer Architecture and Operating Systems, Edifici Q - Campus UAB, Barcelona, Spain
Venue:
Parallel Computing - Algorithmic skeletons
Year:
2006

Citing 16
Cited 9

Allocating Independent Subtasks on Parallel Processors

IEEE Transactions on Software Engineering
Factoring: a method for scheduling parallel loops

Communications of the ACM
Managing performance analysis with dynamic statistical projection pursuit

SC '99 Proceedings of the 1999 ACM/IEEE conference on Supercomputing
The Paradyn Parallel Performance Measurement Tool

Computer
Load Balancing Highly Irregular Computations with the Adaptive Factoring

IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Performance of Scheduling Scientific Applications with Adaptive Weighted Factoring

IPDPS '01 Proceedings of the 15th International Parallel & Distributed Processing Symposium
A Skeleton for Parallel Dynamic Programming

Euro-Par '99 Proceedings of the 5th International Euro-Par Conference on Parallel Processing
An Analytical Model for Pipeline Algorithms on Heterogeneous Clusters

Proceedings of the 9th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
From patterns to frameworks to parallel programs

Parallel Computing - Special issue: Advanced environments for parallel and distributed computing
Task and data parallelism in P3L

Patterns and skeletons for parallel and distributed computing
Bringing skeletons out of the closet: a pragmatic manifesto for skeletal parallel programming

Parallel Computing
Efficient resource management applied to master-worker applications

Journal of Parallel and Distributed Computing - Special issue on middleware
$P$^$3$$T+$: A performance estimator for distributed and parallel programs

Scientific Programming
Dynamic performance tuning supported by program specification

Scientific Programming
Automatic tuning of master/worker applications

Euro-Par'05 Proceedings of the 11th international Euro-Par conference on Parallel Processing
Automatic tuning of data distribution using factoring in master/worker applications

ICCS'05 Proceedings of the 5th international conference on Computational Science - Volume Part II

Dynamic Pipeline Mapping (DPM)

Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
Task distribution using factoring load balancing in Master--Worker applications

Information Processing Letters
Reducing search space of auto-tuners using parallel patterns

IWMSE '09 Proceedings of the 2009 ICSE Workshop on Multicore Software Engineering
Predicting multi-core performance: a case study using Solaris containers

Proceedings of the 3rd International Workshop on Multicore Software Engineering
Data Injection at Execution Time in Grid Environments Using Dynamic Data Driven Application System for Wildland Fire Spread Prediction

CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
Load balancing in homogeneous pipeline based applications

Parallel Computing
MATE: toward scalable automated and dynamic performance tuning environment

PARA'10 Proceedings of the 10th international conference on Applied Parallel and Scientific Computing - Volume 2
A methodology for transparent knowledge specification in a dynamic tuning environment

Software—Practice & Experience
Improving Performance on Data-Intensive Applications Using a Load Balancing Methodology Based on Divisible Load Theory

International Journal of Parallel Programming

Quantified Score

Hi-index	0.00

Visualization

Abstract

Parallel application development is a very difficult task for non-expert programmers, and therefore support tools are needed for all phases of this kind of application development cycle. This means that developing applications using predefined programming structures (frameworks/skeletons) should be easier than doing it from scratch. We propose to take advantage of the intrinsic knowledge that these programming structures provide about the application in order to develop a dynamic and automatic tuning tool. We show that using this knowledge the tool could efficiently make better tuning decisions. Specifically, we focus this work on the definition of the performance model associated to applications developed with the Master/Worker framework.