Parallel job scheduling — a status report

Authors:
Dror G. Feitelson;Larry Rudolph;Uwe Schwiegelshohn
Affiliations:
School of Computer Science and Engineering, The Hebrew University of Jerusalem, Jerusalem, Israel;Laboratory for Computer Science, Massachusetts Institute of Technology, Cambridge, MA;Computer Engineering Institute, Universität Dortmund, Dortmund, Germany
Venue:
JSSPP'04 Proceedings of the 10th international conference on Job Scheduling Strategies for Parallel Processing
Year:
2004

Citing 44
Cited 46

Utopia: a load sharing facility for large, heterogeneous distributed computer systems

Software—Practice & Experience
Exploiting choice: instruction fetch and issue on an implementable simultaneous multithreading processor

ISCA '96 Proceedings of the 23rd annual international symposium on Computer architecture
The Globus toolkit

The grid
Analysis of first-come-first-serve parallel job scheduling

Proceedings of the ninth annual ACM-SIAM symposium on Discrete algorithms
Utilization, Predictability, Workloads, and User Runtime Estimates in Scheduling the IBM SP2 with Backfilling

IEEE Transactions on Parallel and Distributed Systems
An infrastructure for efficient parallel job execution in Terascale computing environments

SC '98 Proceedings of the 1998 ACM/IEEE conference on Supercomputing
Reducing the Variance of Point-to-Point Transfers for Parallel Real-Time Programs

IEEE Parallel & Distributed Technology: Systems & Technology
Evaluation of Job-Scheduling Strategies for Grid Computing

GRID '00 Proceedings of the First IEEE/ACM International Workshop on Grid Computing
Enhanced Algorithms for Multi-site Scheduling

GRID '02 Proceedings of the Third International Workshop on Grid Computing
Supporting Priorities and Improving Utilization of the IBM SP Scheduler Using Slack-Based Backfilling

IPPS '99/SPDP '99 Proceedings of the 13th International Symposium on Parallel Processing and the 10th Symposium on Parallel and Distributed Processing
User-Level Communication in a System with Gang Scheduling

IPDPS '01 Proceedings of the 15th International Parallel & Distributed Processing Symposium
Parallel Processing on Dynamic Resources with CARMI

IPPS '95 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
The ANL/IBM SP Scheduling System

IPPS '95 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Scheduling on the Tera MTA

IPPS '95 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Parallel Job Scheduling: Issues and Approaches

IPPS '95 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Job Scheduling Under the Portable Batch System

IPPS '95 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
PScheD: Political Scheduling on the CRAY T3E

IPPS '97 Proceedings of the Job Scheduling Strategies for Parallel Processing
Valuation of Ultra-scale Computing Systems

IPDPS '00/JSSPP '00 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
The Performance Impact of Advance Reservation Meta-scheduling

IPDPS '00/JSSPP '00 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
The Influence of the Structure and Sizes of Jobs on the Performance of Co-allocation

IPDPS '00/JSSPP '00 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Adaptive Selection of Partition Size for Supercomputer Requests

IPDPS '00/JSSPP '00 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Time-Sharing Parallel Jobs in the Presence of Multiple Resource Requirements

IPDPS '00/JSSPP '00 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Core Algorithms of the Maui Scheduler

JSSPP '01 Revised Papers from the 7th International Workshop on Job Scheduling Strategies for Parallel Processing
The Influence of Communication on the Performance of Co-allocation

JSSPP '01 Revised Papers from the 7th International Workshop on Job Scheduling Strategies for Parallel Processing
Selective Reservation Strategies for Backfill Job Scheduling

JSSPP '02 Revised Papers from the 8th International Workshop on Job Scheduling Strategies for Parallel Processing
The Impact of More Accurate Requested Runtimes on Production Job Scheduling Performance

JSSPP '02 Revised Papers from the 8th International Workshop on Job Scheduling Strategies for Parallel Processing
Economic Scheduling in Grid Computing

JSSPP '02 Revised Papers from the 8th International Workshop on Job Scheduling Strategies for Parallel Processing
STORM: lightning-fast resource management

Proceedings of the 2002 ACM/IEEE conference on Supercomputing
An Integrated Approach to Parallel Scheduling Using Gang-Scheduling, Backfilling, and Migration

IEEE Transactions on Parallel and Distributed Systems
Job-Length Estimation and Performance in Backfilling Schedulers

HPDC '99 Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing
Flexible CoScheduling: Mitigating Load Imbalance and Improving Utilization of Heterogeneous Resources

IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
Gang Scheduling with Memory Considerations

IPDPS '00 Proceedings of the 14th International Symposium on Parallel and Distributed Processing
Improving Parallel Job Scheduling by Combining Gang Scheduling and Backfilling Techniques

IPDPS '00 Proceedings of the 14th International Symposium on Parallel and Distributed Processing
Buffered Coscheduling: A New Methodology for Multitasking Parallel Jobs on Distributed Systems

IPDPS '00 Proceedings of the 14th International Symposium on Parallel and Distributed Processing
On Advantages of Grid Computing for Parallel Job Scheduling

CCGRID '02 Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid
Utilization and Predictability in Scheduling the IBM SP2 with Backfilling

IPPS '98 Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium
Paired Gang Scheduling

IEEE Transactions on Parallel and Distributed Systems
Metric and Workload Effects on Computer Systems Evaluation

Computer
Attributes for communication between Grid scheduling instances

Grid resource management
Applying economic scheduling methods to Grid environments

Grid resource management
The Supercomputer Industry in Light of the Top500 Data

Computing in Science and Engineering
The Case of the Missing Supercomputer Performance: Achieving Optimal Performance on the 8,192 Processors of ASCI Q

Proceedings of the 2003 ACM/IEEE conference on Supercomputing
Job Scheduling in Mesh Multicomputers

ICPP '94 Proceedings of the 1994 International Conference on Parallel Processing - Volume 02
A dynamic co-allocation service in multicluster systems

JSSPP'04 Proceedings of the 10th international conference on Job Scheduling Strategies for Parallel Processing

Self-Adaptive Scheduler Parameterization via Online Simulation

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
System noise, OS clock ticks, and fine-grained parallel applications

Proceedings of the 19th annual international conference on Supercomputing
Efficient Subtorus Processor Allocation in a Multi-Dimensional Torus

HPCASIA '05 Proceedings of the Eighth International Conference on High-Performance Computing in Asia-Pacific Region
The Impact of Information Availability and Workload Characteristics on the Performance of Job Co-allocation in Multi-clusters

ICPADS '06 Proceedings of the 12th International Conference on Parallel and Distributed Systems - Volume 1
Backfilling Using System-Generated Predictions Rather than User Runtime Estimates

IEEE Transactions on Parallel and Distributed Systems
On-line scheduling of parallel jobs on two machines

Journal of Discrete Algorithms
A job scheduling framework for large computing farms

Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Scheduling mixed-parallel applications with advance reservations

HPDC '08 Proceedings of the 17th international symposium on High performance distributed computing
Multitasking workload scheduling on flexible core chip multiprocessors

ACM SIGARCH Computer Architecture News
Co-allocation with Communication Considerations in Multi-cluster Systems

Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
The hybrid scheduling framework for virtual machine systems

Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
Resource co-allocation for large-scale distributed environments

Proceedings of the 18th ACM international symposium on High performance distributed computing
Performance, fairness and effectiveness in space-slicing multi-cluster schedulers

PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
Evaluating the impact of inaccurate information in utility-based scheduling

Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
Task Parallel Scheduling over Multi-core System

CloudCom '09 Proceedings of the 1st International Conference on Cloud Computing
New challenges of parallel job scheduling

JSSPP'07 Proceedings of the 13th international conference on Job scheduling strategies for parallel processing
Group-wise performance evaluation of processor co-allocation in multi-cluster systems

JSSPP'07 Proceedings of the 13th international conference on Job scheduling strategies for parallel processing
A job self-scheduling policy for HPC infrastructures

JSSPP'07 Proceedings of the 13th international conference on Job scheduling strategies for parallel processing
Impact of reservations on production job scheduling

JSSPP'07 Proceedings of the 13th international conference on Job scheduling strategies for parallel processing
A Bi-criteria Algorithm for Scheduling Parallel Task Graphs on Clusters

CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
On cluster resource allocation for multiple parallel task graphs

Journal of Parallel and Distributed Computing
Multisite co-allocation algorithms for computational grid

IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Resource provisioning in SLA-based cluster computing

JSSPP'10 Proceedings of the 15th international conference on Job scheduling strategies for parallel processing
Dynamic proportional share scheduling in Hadoop

JSSPP'10 Proceedings of the 15th international conference on Job scheduling strategies for parallel processing
Using inaccurate estimates accurately

JSSPP'10 Proceedings of the 15th international conference on Job scheduling strategies for parallel processing
CASP: a community-aware scheduling protocol

International Journal of Grid and Utility Computing
Supporting GPU sharing in cloud environments with a transparent runtime consolidation framework

Proceedings of the 20th international symposium on High performance distributed computing
Dynamic adaptive scheduling for virtual machines

Proceedings of the 20th international symposium on High performance distributed computing
A multi-level scheduler for batch jobs on grids

The Journal of Supercomputing
Backfilling with guarantees granted upon job submission

Euro-Par'11 Proceedings of the 17th international conference on Parallel processing - Volume Part I
Evolving toward the perfect schedule: co-scheduling job assignments and data replication in wide-area systems using a genetic algorithm

JSSPP'05 Proceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing
Pitfalls in parallel job scheduling evaluation

JSSPP'05 Proceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing
GreenHadoop: leveraging green energy in data-processing frameworks

Proceedings of the 7th ACM european conference on Computer Systems
Towards scheduling evolving applications

Euro-Par'11 Proceedings of the 2011 international conference on Parallel Processing
Scheduling Concurrent Applications on a Cluster of CPU-GPU Nodes

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Decentralized scalable fairshare scheduling

Future Generation Computer Systems
An effective and robust two-phase resource allocation scheme for interdependent tasks in mobile ad hoc computational Grids

Journal of Parallel and Distributed Computing
A multi-criteria job scheduling framework for large computing farms

Journal of Computer and System Sciences
Context-Aware Job Scheduling for Cloud Computing Environments

UCC '12 Proceedings of the 2012 IEEE/ACM Fifth International Conference on Utility and Cloud Computing
Online cost-efficient scheduling of deadline-constrained workloads on hybrid clouds

Future Generation Computer Systems
MIP model scheduling for multi-clusters

Euro-Par'12 Proceedings of the 18th international conference on Parallel processing workshops
Evaluation of reallocation heuristics for moldable tasks in computational grids

AusPDC '11 Proceedings of the Ninth Australasian Symposium on Parallel and Distributed Computing - Volume 118
A preemption-based runtime to efficiently schedule multi-process applications on heterogeneous clusters with GPUs

Proceedings of the 22nd international symposium on High-performance parallel and distributed computing
Exploring portfolio scheduling for long-term execution of scientific workloads in IaaS clouds

SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Scheduling concurrent applications on a cluster of CPU-GPU nodes

Future Generation Computer Systems
TLA: Temporal look-ahead processor allocation method for heterogeneous multi-cluster systems

Journal of Parallel and Distributed Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

The popularity of research on the scheduling of parallel jobs demands a periodic review of the status of the field. Indeed, several surveys have been written on this topic in the context of parallel supercomputers [17, 20]. The purpose of the present paper is to update that material, and to extend it to include work concerning clusters and the grid.