Partitioning Techniques for Large-Grained Parallelism
IEEE Transactions on Computers
Scheduling Divisible Loads in Parallel and Distributed Systems
Scheduling Divisible Loads in Parallel and Distributed Systems
Divisible Load Scheduling in Systems with Limited Memory
Cluster Computing
A new model of multi-installment divisible loads processing in systems with limited memory
PPAM'07 Proceedings of the 7th international conference on Parallel processing and applied mathematics
Multi-installment divisible load processing in heterogeneous systems with limited memory
PPAM'05 Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics
Scheduling divisible MapReduce computations
Journal of Parallel and Distributed Computing
Hi-index | 7.29 |
In this paper we study divisible load scheduling in systems with limited memory. Divisible loads are parallel computations which can be divided into independent parts processed in parallel on remote computers, and the part sizes may be arbitrary. The distributed system is a heterogeneous single level tree. The total size of processor memories is too small to accommodate the whole load at any moment of time. Therefore, the load is distributed in many rounds. Memory reservations have block nature. The problem consists in distributing the load taking into account communication time, computation time, and limited memory buffers so that the whole processing finishes as early as possible. This problem is both combinatorial and algebraic in nature. Therefore, hybrid algorithms are given to solve it. Two algorithms are proposed to solve the combinatorial component. A branch-and-bound algorithm is nearly unusable due to its complexity. Then, a genetic algorithm is proposed with more tractable execution times. For a given solution of the combinatorial part we formulate the solution of the algebraic part as a linear programming problem. An extensive computational study is performed to analyze the impact of various system parameters on the quality of the solutions. From this we were able to infer on the nature of the scheduling problem.