Dynamic programming: deterministic and stochastic models
Dynamic programming: deterministic and stochastic models
Dynamic Remapping of Parallel Computations with Varying Resource Demands
IEEE Transactions on Computers
Parallel and distributed computation: numerical methods
Parallel and distributed computation: numerical methods
Optimal Dynamic Remapping of Data Parallel Computations
IEEE Transactions on Computers
An Analysis of Scatter Decomposition
IEEE Transactions on Computers
Performance of dynamic load balancing algorithms for unstructured mesh calculations
Concurrency: Practice and Experience
Concurrency: Practice and Experience
Efficient load balancing and data remapping for adaptive grid calculations
Proceedings of the ninth annual ACM symposium on Parallel algorithms and architectures
Automated parallelization of discrete state-space generation
Journal of Parallel and Distributed Computing - Special issue on dynamic load balancing
Dynamic data distribution and processor repartitioning for irregularly structured computations
Journal of Parallel and Distributed Computing - Special issue on irregular problems in supercomputing applications
Load Balancing in Parallel Computers: Theory and Practice
Load Balancing in Parallel Computers: Theory and Practice
Parallel Computer Architecture: A Hardware/Software Approach
Parallel Computer Architecture: A Hardware/Software Approach
Beyond Execution Time: Expanding the Use of Performance Models
IEEE Parallel & Distributed Technology: Systems & Technology
Performance of Synchronous Parallel Algorithms with Regular Structures
IEEE Transactions on Parallel and Distributed Systems
Performance Analysis of Synchronized Iterative Algorithms on Multiprocessor Systems
IEEE Transactions on Parallel and Distributed Systems
Runtime Incremental Parallel Scheduling (RIPS) on Distributed Memory Computers
IEEE Transactions on Parallel and Distributed Systems
A Practical Approach to Dynamic Load Balancing
IEEE Transactions on Parallel and Distributed Systems
Relaxed Implementation of Spectral Methods for Graph Partitioning
IRREGULAR '98 Proceedings of the 5th International Symposium on Solving Irregularly Structured Problems in Parallel
Optimal Periodic Remapping of Bulk Synchronous Computations on Multiprogrammed Distributed Systems
IPDPS '00 Proceedings of the 14th International Symposium on Parallel and Distributed Processing
Optimal periodic remapping of dynamic bulk synchronous computations
Journal of Parallel and Distributed Computing
Stochastic modeling and analysis of hybrid mobility in reconfigurable distributed virtual machines
Journal of Parallel and Distributed Computing
Automatica (Journal of IFAC)
Hi-index | 0.00 |
A bulk synchronous computation proceeds in phases that are separated by barrier synchronization. For dynamic bulk synchronous computations that exhibit varying phase-wise computational requirements, remapping at runtime is an effective approach to ensure parallel efficiency. This paper introduces a novel remapping strategy for computations whose workload changes can be modeled as a Markov chain. The use of Markovian model allows us to treat statistical dependence and more complex structure than the usual independent identically distributed random variable assumptions. Our models are quite general and we do not need to impose conditions on the dynamics of the underlying process other than the transition probability matrix. It is shown that optimal remapping can be formulated as a binary decision process: remap or not at a given synchronizing instant. The optimal strategy is then developed for long lasted computations by employing optimal stopping rules in a stochastic control framework. The existence of optimal controls is established. Necessary and sufficient conditions for the optimality are obtained. Furthermore, a policy iteration algorithm is devised to reduce computational complexity and enhance fast convergence to the desired optimal control.