A dynamic processor allocation policy for multiprogrammed shared-memory multiprocessors
ACM Transactions on Computer Systems (TOCS)
The elusive goal of workload characterization
ACM SIGMETRICS Performance Evaluation Review
The Concurrent Supercomputing Consortium: Year 1
IEEE Parallel & Distributed Technology: Systems & Technology
Job Scheduling is More Important than Processor Allocation for Hypercube Computers
IEEE Transactions on Parallel and Distributed Systems
IPPS '99/SPDP '99 Proceedings of the 13th International Symposium on Parallel Processing and the 10th Symposium on Parallel and Distributed Processing
Scheduling of a Parallel Workload: Implementation and Use of the Argonne Easy Scheduler at PDC
PARA '98 Proceedings of the 4th International Workshop on Applied Parallel Computing, Large Scale Scientific and Industrial Problems
The ANL/IBM SP Scheduling System
IPPS '95 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Job Characteristics of a Production Parallel Scientivic Workload on the NASA Ames iPSC/860
IPPS '95 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Packing Schemes for Gang Scheduling
IPPS '96 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Workload Evolution on the Cornell Theory Center IBM SP2
IPPS '96 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
The EASY - LoadLeveler API Project
IPPS '96 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
IPPS '97 Proceedings of the Job Scheduling Strategies for Parallel Processing
A Historical Application Profiler for Use by Parallel Schedulers
IPPS '97 Proceedings of the Job Scheduling Strategies for Parallel Processing
Theory and Practice in Parallel Job Scheduling
IPPS '97 Proceedings of the Job Scheduling Strategies for Parallel Processing
Improved Utilization and Responsiveness with Gang Scheduling
IPPS '97 Proceedings of the Job Scheduling Strategies for Parallel Processing
Using Queue Time Predictions for Processor Allocation
IPPS '97 Proceedings of the Job Scheduling Strategies for Parallel Processing
IPPS/SPDP '98 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Predicting Application Run Times Using Historical Information
IPPS/SPDP '98 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Job-Length Estimation and Performance in Backfilling Schedulers
HPDC '99 Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing
Utilization and Predictability in Scheduling the IBM SP2 with Backfilling
IPPS '98 Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium
Multiple-queue backfilling scheduling with priorities and reservations for parallel systems
ACM SIGMETRICS Performance Evaluation Review
On Job Scheduling for HPC-Clusters and the dynP Scheduler
HiPC '01 Proceedings of the 8th International Conference on High Performance Computing
A Symbolic Approachto Modeling Cellular Behavior
HiPC '02 Proceedings of the 9th International Conference on High Performance Computing
Metrics for Parallel Job Scheduling and Their Convergence
JSSPP '01 Revised Papers from the 7th International Workshop on Job Scheduling Strategies for Parallel Processing
Multiple-Queue Backfilling Scheduling with Priorities and Reservations for Parallel Systems
JSSPP '02 Revised Papers from the 8th International Workshop on Job Scheduling Strategies for Parallel Processing
Selective Reservation Strategies for Backfill Job Scheduling
JSSPP '02 Revised Papers from the 8th International Workshop on Job Scheduling Strategies for Parallel Processing
A Self-Tuning Job Scheduler Family with Dynamic Policy Switching
JSSPP '02 Revised Papers from the 8th International Workshop on Job Scheduling Strategies for Parallel Processing
The Impact of More Accurate Requested Runtimes on Production Job Scheduling Performance
JSSPP '02 Revised Papers from the 8th International Workshop on Job Scheduling Strategies for Parallel Processing
The Forgotten Factor: Facts on Performance Evaluation and Its Dependence on Workloads
Euro-Par '02 Proceedings of the 8th International Euro-Par Conference on Parallel Processing
Workload Modeling for Performance Evaluation
Performance Evaluation of Complex Systems: Techniques and Tools, Performance 2002, Tutorial Lectures
IEEE Transactions on Parallel and Distributed Systems
Experimental Analysis of the Root Causes of Performance Evaluation Results: A Backfilling Case Study
IEEE Transactions on Parallel and Distributed Systems
Self-Adaptive Scheduler Parameterization via Online Simulation
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
Improving and Stabilizing Parallel Computer Performance Using Adaptive Backfilling
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
On the Scalability of Centralized Control
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 18 - Volume 19
Power-aware resource allocation in high-end systems via online simulation
Proceedings of the 19th annual international conference on Supercomputing
Another approach to backfilled jobs: applying virtual malleability to expired windows
Proceedings of the 19th annual international conference on Supercomputing
Adaptive Parallel Job Scheduling with Flexible Coscheduling
IEEE Transactions on Parallel and Distributed Systems
Cross-Platform Performance Prediction of Parallel Applications Using Partial Execution
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
On the Distribution of Sequential Jobs in Random Brokering for Heterogeneous Computational Grids
IEEE Transactions on Parallel and Distributed Systems
The impact of data replication on job scheduling performance in the Data Grid
Future Generation Computer Systems
LOMARC: Lookahead Matchmaking for Multiresource Coscheduling on Hyperthreaded CPUs
IEEE Transactions on Parallel and Distributed Systems
Backfilling with lookahead to optimize the packing of parallel jobs
Journal of Parallel and Distributed Computing
A multi-dimensional scheduling scheme in a Grid computing environment
Journal of Parallel and Distributed Computing
Backfilling Using System-Generated Predictions Rather than User Runtime Estimates
IEEE Transactions on Parallel and Distributed Systems
Precise and realistic utility functions for user-centric performance analysis of schedulers
Proceedings of the 16th international symposium on High performance distributed computing
On the User-Scheduler Dialogue: Studies of User-Provided Runtime Estimates and Utility Functions
International Journal of High Performance Computing Applications
Bid based scheduler with backfilling for a multiprocessor system
Proceedings of the ninth international conference on Electronic commerce
Development of scheduling strategies with Genetic Fuzzy systems
Applied Soft Computing
Pricing for Utility-Driven Resource Management and Allocation in Clusters
International Journal of High Performance Computing Applications
Xen and the Art of Cluster Scheduling
VTDC '06 Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing
Multitoroidal Interconnects For Tightly Coupled Supercomputers
IEEE Transactions on Parallel and Distributed Systems
Allocation strategies for utilization of space-shared resources in Bag of Tasks grids
Future Generation Computer Systems
Selective preemption strategies for parallel job scheduling
International Journal of High Performance Computing and Networking
Adaptive time/space sharing with SCOJO
International Journal of High Performance Computing and Networking
Robust scheduling of moldable parallel jobs
International Journal of High Performance Computing and Networking
Inter-operating grids through delegated matchmaking
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
A job scheduling framework for large computing farms
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Secretly monopolizing the CPU without superuser privileges
SS'07 Proceedings of 16th USENIX Security Symposium on USENIX Security Symposium
Using checkpointing to recover from poor multi-site parallel job scheduling decisions
Proceedings of the 5th international workshop on Middleware for grid computing: held at the ACM/IFIP/USENIX 8th International Middleware Conference
Future Generation Computer Systems
Scheduling mixed-parallel applications with advance reservations
HPDC '08 Proceedings of the 17th international symposium on High performance distributed computing
VARQ: virtual advance reservations for queues
HPDC '08 Proceedings of the 17th international symposium on High performance distributed computing
Combining batch execution and leasing using virtual machines
HPDC '08 Proceedings of the 17th international symposium on High performance distributed computing
A two-level scheduler to dynamically schedule a stream of batch jobs in large-scale grids
HPDC '08 Proceedings of the 17th international symposium on High performance distributed computing
Inter-operating grids through Delegated MatchMaking
Scientific Programming - Large-Scale Programming Tools and Environments
CGA: Chaotic Genetic Algorithm for Fuzzy Job Scheduling in Grid Environment
Computational Intelligence and Security
Adaptive Request Scheduling for Parallel Scientific Web Services
SSDBM '08 Proceedings of the 20th international conference on Scientific and Statistical Database Management
The Power of Preemption in Economic Online Markets
GECON '08 Proceedings of the 5th international workshop on Grid Economics and Business Models
Achieving efficiency, quality of service and robustness in multi-organizational Grids
Journal of Systems and Software
Heuristic for resources allocation on utility computing infrastructures
Proceedings of the 6th international workshop on Middleware for grid computing
Performance analysis of allocation policies for interGrid resource provisioning
Information and Software Technology
Adaptive pricing for resource reservations in Shared environments
GRID '07 Proceedings of the 8th IEEE/ACM International Conference on Grid Computing
Incentives to Tight the Runtime Estimates of EASY Backfilling
ICDCN '09 Proceedings of the 10th International Conference on Distributed Computing and Networking
Euro-Par 2008 Workshops - Parallel Processing
GPC '09 Proceedings of the 4th International Conference on Advances in Grid and Pervasive Computing
Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters
Proceedings of the 18th ACM international symposium on High performance distributed computing
Liana: a decentralized load-dependent scheduler for performance-cost optimization of grid service
The Journal of Supercomputing
On the importance of migration for fairness in online grid markets
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
Harnessing migrations in a market-based grid OS
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
Rescheduling co-allocation requests based on flexible advance reservations and processor remapping
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
Scheduling mixed-parallel applications with advance reservations
Cluster Computing
Minimizing dependencies within generic classes for faster and smaller programs
Proceedings of the 24th ACM SIGPLAN conference on Object oriented programming systems languages and applications
PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
The impact of runtime estimation inaccuracy on scheduler performance
PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
Performance problems of using system-predicted runtimes for parallel job scheduling
PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
Evaluating the impact of inaccurate information in utility-based scheduling
Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
Hierarchical scheduling mechanism for grid systems
IMSA '07 Proceedings of the Eleventh IASTED International Conference on Internet and Multimedia Systems and Applications
Resource allocation and utilization in the Blue Gene/L supercomputer
IBM Journal of Research and Development
The impact of data replication on job scheduling performance in the Data Grid
Future Generation Computer Systems
Advance reservation policies for workflows
JSSPP'06 Proceedings of the 12th international conference on Job scheduling strategies for parallel processing
On advantages of scheduling using genetic fuzzy systems
JSSPP'06 Proceedings of the 12th international conference on Job scheduling strategies for parallel processing
Moldable parallel job scheduling using job efficiency: an iterative approach
JSSPP'06 Proceedings of the 12th international conference on Job scheduling strategies for parallel processing
Group-wise performance evaluation of processor co-allocation in multi-cluster systems
JSSPP'07 Proceedings of the 13th international conference on Job scheduling strategies for parallel processing
JSSPP'07 Proceedings of the 13th international conference on Job scheduling strategies for parallel processing
HiPC'08 Proceedings of the 15th international conference on High performance computing
An adaptive job scheduling scheme for mesh-connected multicomputers
The Journal of Supercomputing
On the Use of Machine Learning to Predict the Time and Resources Consumed by Applications
CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
A fuzzy rule-based meta-scheduler with evolutionary learning for grid computing
Engineering Applications of Artificial Intelligence
PV-EASY: a strict fairness guaranteed and prediction enabled scheduler in parallel job scheduling
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Cluster-wide context switch of virtualized jobs
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
On cluster resource allocation for multiple parallel task graphs
Journal of Parallel and Distributed Computing
Instability in parallel job scheduling simulation: the role of workload flurries
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Risk aware overbooking for commercial grids
JSSPP'10 Proceedings of the 15th international conference on Job scheduling strategies for parallel processing
The importance of complete data sets for job scheduling simulations
JSSPP'10 Proceedings of the 15th international conference on Job scheduling strategies for parallel processing
Multiplexing low and high QoS workloads in virtual environments
JSSPP'10 Proceedings of the 15th international conference on Job scheduling strategies for parallel processing
Using inaccurate estimates accurately
JSSPP'10 Proceedings of the 15th international conference on Job scheduling strategies for parallel processing
Online scheduling of workflow applications in grid environments
Future Generation Computer Systems
Job Allocation Strategies with User Run Time Estimates for Online Scheduling in Hierarchical Grids
Journal of Grid Computing
Environment-conscious scheduling of HPC applications on distributed Cloud-oriented data centers
Journal of Parallel and Distributed Computing
On/off-line prediction applied to job scheduling on non-dedicated NOWs
Journal of Computer Science and Technology - Special issue on natural language processing
Towards a profound analysis of bags-of-tasks in parallel systems and their performance impact
Proceedings of the 20th international symposium on High performance distributed computing
Service control with the preemptive parallel job scheduler Scojo-PECT
Cluster Computing
A multi-level scheduler for batch jobs on grids
The Journal of Supercomputing
Backfilling with guarantees granted upon job submission
Euro-Par'11 Proceedings of the 17th international conference on Parallel processing - Volume Part I
Slot selection and co-allocation for economic scheduling in distributed computing
PaCT'11 Proceedings of the 11th international conference on Parallel computing technologies
GreenSlot: scheduling energy consumption in green datacenters
Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
Reducing electricity cost through virtual machine placement in high performance computing clouds
Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
Research on Power-Aware Scheduling for High-Performance Computing System
GREENCOM '11 Proceedings of the 2011 IEEE/ACM International Conference on Green Computing and Communications
Adaptive resource remapping through live migration of virtual machines
ICA3PP'11 Proceedings of the 11th international conference on Algorithms and architectures for parallel processing - Volume Part I
Advanced reservation-based scheduling of task graphs on clusters
HiPC'06 Proceedings of the 13th international conference on High Performance Computing
Improving scheduling decisions by using knowledge about parallel applications resource usage
HPCC'05 Proceedings of the First international conference on High Performance Computing and Communications
Parallel job scheduling — a status report
JSSPP'04 Proceedings of the 10th international conference on Job Scheduling Strategies for Parallel Processing
Enhancements to the decision process of the self-tuning dynp scheduler
JSSPP'04 Proceedings of the 10th international conference on Job Scheduling Strategies for Parallel Processing
JSSPP'04 Proceedings of the 10th international conference on Job Scheduling Strategies for Parallel Processing
Costs and benefits of load sharing in the computational grid
JSSPP'04 Proceedings of the 10th international conference on Job Scheduling Strategies for Parallel Processing
Are user runtime estimates inherently inaccurate?
JSSPP'04 Proceedings of the 10th international conference on Job Scheduling Strategies for Parallel Processing
Using on-the-fly simulation for estimating the turnaround time on non-dedicated clusters
Euro-Par'06 Proceedings of the 12th international conference on Parallel Processing
CISNE: a new integral approach for scheduling parallel applications on non-dedicated clusters
Euro-Par'05 Proceedings of the 11th international Euro-Par conference on Parallel Processing
Online scheduling of workflow applications in grid environment
GPC'10 Proceedings of the 5th international conference on Advances in Grid and Pervasive Computing
Modeling user runtime estimates
JSSPP'05 Proceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing
ScoPred–scalable user-directed performance prediction using complexity modeling and historical data
JSSPP'05 Proceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing
Open job management architecture for the blue gene/l supercomputer
JSSPP'05 Proceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing
JSSPP'05 Proceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing
JSSPP'05 Proceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing
Unfairness metrics for space-sharing parallel job schedulers
JSSPP'05 Proceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing
Pitfalls in parallel job scheduling evaluation
JSSPP'05 Proceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing
An enhanced grid scheduling with job priority and equitable interval job distribution
GPC'06 Proceedings of the First international conference on Advances in Grid and Pervasive Computing
Efficient data representation of large job schedules
MEMICS'11 Proceedings of the 7th international conference on Mathematical and Engineering Methods in Computer Science
Towards scheduling evolving applications
Euro-Par'11 Proceedings of the 2011 international conference on Parallel Processing
Computing resource prediction for mapreduce applications using decision tree
APWeb'12 Proceedings of the 14th Asia-Pacific international conference on Web Technologies and Applications
Improvements to the structural simulation toolkit
Proceedings of the 5th International ICST Conference on Simulation Tools and Techniques
The Journal of Supercomputing
Multiple Workflow Scheduling Strategies with User Run Time Estimates on a Grid
Journal of Grid Computing
Failure-aware resource provisioning for hybrid Cloud infrastructure
Journal of Parallel and Distributed Computing
Decentralized scalable fairshare scheduling
Future Generation Computer Systems
Parallel job scheduling for power constrained HPC systems
Parallel Computing
A job scheduling approach for multi-core clusters based on virtual malleability
Euro-Par'12 Proceedings of the 18th international conference on Parallel Processing
A multi-criteria job scheduling framework for large computing farms
Journal of Computer and System Sciences
Enhancing performance of failure-prone clusters by adaptive provisioning of cloud resources
The Journal of Supercomputing
Online cost-efficient scheduling of deadline-constrained workloads on hybrid clouds
Future Generation Computer Systems
Double auction-inspired meta-scheduling of parallel applications on global grids
Journal of Parallel and Distributed Computing
Evaluation of reallocation heuristics for moldable tasks in computational grids
AusPDC '11 Proceedings of the Ninth Australasian Symposium on Parallel and Distributed Computing - Volume 118
Exploring portfolio scheduling for long-term execution of scientific workloads in IaaS clouds
SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Extending goal-oriented parallel computer job scheduling policies to heterogeneous systems
The Journal of Supercomputing
Improving user QoS by relaxing resource reservation policy in high-performance grid environments
International Journal of Grid and Utility Computing
TLA: Temporal look-ahead processor allocation method for heterogeneous multi-cluster systems
Journal of Parallel and Distributed Computing
Toward balanced and sustainable job scheduling for production supercomputers
Parallel Computing
| Hi-index | 0.00 |
Scheduling jobs on the IBM SP2 system and many other distributed-memory MPPs is usually done by giving each job a partition of the machine for its exclusive use. Allocating such partitions in the order in which the jobs arrive (FCFS scheduling) is fair and predictable, but suffers from severe fragmentation, leading to low utilization. This situation led to the development of the EASY scheduler which uses aggressive backfilling: Small jobs are moved ahead to fill in holes in the schedule, provided they do not delay the first job in the queue. We compare this approach with a more conservative approach in which small jobs move ahead only if they do not delay any job in the queue and show that the relative performance of the two schemes depends on the workload: For workloads typical on SP2 systems, the aggressive approach is indeed better, but, for other workloads, both algorithms are similar. In addition, we study the sensitivity of backfilling to the accuracy of the runtime estimates provided by the users and find a very surprising result: Backfilling actually works better when users overestimate the runtime by a substantial factor.