Adaptive load sharing in homogeneous distributed systems
IEEE Transactions on Software Engineering
Using idle workstations in a shared computing environment
SOSP '87 Proceedings of the eleventh ACM Symposium on Operating systems principles
Tight bounds on the complexity of parallel sorting
IEEE Transactions on Computers
Communications of the ACM
Process control and scheduling issues for multiprogrammed shared-memory multiprocessors
SOSP '89 Proceedings of the twelfth ACM symposium on Operating systems principles
Characterizations of parallelism in applications and their use in scheduling
SIGMETRICS '89 Proceedings of the 1989 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Finding Idle Machines in a Workstation-Based Distributed System
IEEE Transactions on Software Engineering
PVM: a framework for parallel distributed computing
Concurrency: Practice and Experience
The performance of multiprogrammed multiprocessor scheduling algorithms
SIGMETRICS '90 Proceedings of the 1990 ACM SIGMETRICS conference on Measurement and modeling of computer systems
SIGMETRICS '91 Proceedings of the 1991 ACM SIGMETRICS conference on Measurement and modeling of computer systems
A comparison of sorting algorithms for the connection machine CM-2
SPAA '91 Proceedings of the third annual ACM symposium on Parallel algorithms and architectures
Transparent process migration: design alternatives and the sprite implementation
Software—Practice & Experience
The available capacity of a privately owned workstation environment
Performance Evaluation
Concurrent reading and writing of clocks
ACM Transactions on Computer Systems (TOCS)
Active messages: a mechanism for integrated communication and computation
ISCA '92 Proceedings of the 19th annual international symposium on Computer architecture
The network architecture of the Connection Machine CM-5 (extended abstract)
SPAA '92 Proceedings of the fourth annual ACM symposium on Parallel algorithms and architectures
Scheduling a mixed interactive and batch workload on a parallel, shared memory supercomputer
Proceedings of the 1992 ACM/IEEE conference on Supercomputing
LogP: towards a realistic model of parallel computation
PPOPP '93 Proceedings of the fourth ACM SIGPLAN symposium on Principles and practice of parallel programming
High-speed switch scheduling for local-area networks
ACM Transactions on Computer Systems (TOCS)
Distributed computing feasibility in a non-dedicated homogeneous distributed system
Proceedings of the 1993 ACM/IEEE conference on Supercomputing
Parallel programming in Split-C
Proceedings of the 1993 ACM/IEEE conference on Supercomputing
Performance analysis of job scheduling policies in parallel supercomputing environments
Proceedings of the 1993 ACM/IEEE conference on Supercomputing
Analysis of the impact of memory in distributed parallel processing systems
SIGMETRICS '94 Proceedings of the 1994 ACM SIGMETRICS conference on Measurement and modeling of computer systems
Processor allocation policies for message-passing parallel computers
SIGMETRICS '94 Proceedings of the 1994 ACM SIGMETRICS conference on Measurement and modeling of computer systems
SIGMETRICS '94 Proceedings of the 1994 ACM SIGMETRICS conference on Measurement and modeling of computer systems
Software versus hardware shared-memory implementation: a case study
ISCA '94 Proceedings of the 21st annual international symposium on Computer architecture
Virtual memory mapped network interface for the SHRIMP multicomputer
ISCA '94 Proceedings of the 21st annual international symposium on Computer architecture
Tempest and typhoon: user-level shared memory
ISCA '94 Proceedings of the 21st annual international symposium on Computer architecture
Scheduling and page migration for multiprocessor compute servers
ASPLOS VI Proceedings of the sixth international conference on Architectural support for programming languages and operating systems
VAXcluster: a closely-coupled distributed system
ACM Transactions on Computer Systems (TOCS)
Preemptable remote execution facilities for the V-system
Proceedings of the tenth ACM symposium on Operating systems principles
Multiprogramming on Multiprocessors
Multiprogramming on Multiprocessors
Effective distributed scheduling of parallel workloads
Proceedings of the 1996 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
High-performance sorting on networks of workstations
SIGMOD '97 Proceedings of the 1997 ACM SIGMOD international conference on Management of data
The utility of exploiting idle workstations for parallel computation
SIGMETRICS '97 Proceedings of the 1997 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Scheduling with implicit information in distributed systems
SIGMETRICS '98/PERFORMANCE '98 Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
Using idle memory for data-intensive computations (extended abstract)
SIGMETRICS '98/PERFORMANCE '98 Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
Availability and utility of idle memory in workstation clusters
SIGMETRICS '99 Proceedings of the 1999 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Mechanisms and policies for supporting fine-grained cycle stealing
ICS '99 Proceedings of the 13th international conference on Supercomputing
A closer look at coscheduling approaches for a network of workstations
Proceedings of the eleventh annual ACM symposium on Parallel algorithms and architectures
Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs
Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Exploiting Fine-Grained Idle Periods in Networks of Workstations
IEEE Transactions on Parallel and Distributed Systems
Implicit coscheduling: coordinated scheduling with implicit information in distributed systems
ACM Transactions on Computer Systems (TOCS)
Linger Longer: fine-grain cycle stealing for networks of workstations
SC '98 Proceedings of the 1998 ACM/IEEE conference on Supercomputing
Efficient network and I/O throttling for fine-grain cycle stealing
Proceedings of the 2001 ACM/IEEE conference on Supercomputing
ACM Transactions on Computer Systems (TOCS)
Fair Scheduling of General-Purpose Workloads on Workstation Clusters
Cluster Computing
Performance Modeling and Prediction of Nondedicated Network Computing
IEEE Transactions on Computers
CMC: A Coscheduling Model for non-Dedicated Cluster Computing
IPDPS '01 Proceedings of the 15th International Parallel & Distributed Processing Symposium
Coscheduling under Memory Constraints in a NOW Environment
JSSPP '01 Revised Papers from the 7th International Workshop on Job Scheduling Strategies for Parallel Processing
Implementing Explicit and Implicit Coscheduling in a PVM Environment (Research Note)
Euro-Par '00 Proceedings from the 6th International Euro-Par Conference on Parallel Processing
Predictive Coscheduling Implementation in a Non-dedicated Linux Cluster
Euro-Par '01 Proceedings of the 7th International Euro-Par Conference Manchester on Parallel Processing
Instant-Access Cycle-Stealing for Parallel Applications Requiring Interactive Response
Euro-Par '02 Proceedings of the 8th International Euro-Par Conference on Parallel Processing
VECPAR '00 Selected Papers and Invited Talks from the 4th International Conference on Vector and Parallel Processing
Implementing and Analysing an Effective Explicit Coscheduling Algorithm on a NOW
VECPAR '00 Selected Papers and Invited Talks from the 4th International Conference on Vector and Parallel Processing
Simulating Load Balancing on Heterogeneous Workstation Clusters
ParNum '99 Proceedings of the 4th International ACPC Conference Including Special Tracks on Parallel Numerics and Parallel Computing in Image Processing, Video Processing, and Multimedia: Parallel Computation
Achieving Robust, Scalable Cluster I/O in Java
LCR '00 Selected Papers from the 5th International Workshop on Languages, Compilers, and Run-Time Systems for Scalable Computers
Adding Dynamic Coscheduling Support to PVM
Proceedings of the 8th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Building MPI for Multi-Programming Systems Using Implicit Information
Proceedings of the 6th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
STORM: lightning-fast resource management
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
HCW '98 Proceedings of the Seventh Heterogeneous Computing Workshop
Simulation of Heterogeneous Networks of Workstations
MASCOTS '96 Proceedings of the 4th International Workshop on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems
Cluster scheduling for explicitly-speculative tasks
Proceedings of the 18th annual international conference on Supercomputing
Resource Policing to Support Fine-Grain Cycle Stealing in Networks of Workstations
IEEE Transactions on Parallel and Distributed Systems
Resource Management for Rapid Application Turnaround on Enterprise Desktop Grids
Proceedings of the 2004 ACM/IEEE conference on Supercomputing
Journal of Parallel and Distributed Computing
On-line automated performance diagnosis on thousands of processes
Proceedings of the eleventh ACM SIGPLAN symposium on Principles and practice of parallel programming
A multi-layer resource reconfiguration framework for grid computing
Proceedings of the 4th international workshop on Middleware for grid computing
Grid harvest service: a performance system of grid computing
Journal of Parallel and Distributed Computing
Characterizing resource availability in enterprise desktop grids
Future Generation Computer Systems
Adaptive and reliable parallel computing on networks of workstations
ATEC '97 Proceedings of the annual conference on USENIX Annual Technical Conference
International Journal of High Performance Computing Applications
Self-adaptive task allocation and scheduling of meta-tasks in non-dedicated heterogeneous computing
International Journal of High Performance Computing and Networking
Multi-state grid resource availability characterization
GRID '07 Proceedings of the 8th IEEE/ACM International Conference on Grid Computing
Availability Traces of Enterprise Desktop Grids
GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
International Journal of High Performance Computing and Networking
Scheduling on the Grid via multi-state resource availability prediction
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
Minimizing paging tradeoffs applying coscheduling techniques in a linux cluster
VECPAR'02 Proceedings of the 5th international conference on High performance computing for computational science
Peer enterprises: possibilities, challenges and some ideas towards their realization
OTM'07 Proceedings of the 2007 OTM Confederated international conference on On the move to meaningful internet systems - Volume Part II
Peer enterprises: a viable alternative to cloud computing?
IMSAA'09 Proceedings of the 3rd IEEE international conference on Internet multimedia services architecture and applications
Toward high performance computing in unconventional computing environments
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Improving cluster utilization through intelligent processor sharing
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
PeerMon: a peer-to-peer network monitoring system
LISA'10 Proceedings of the 24th international conference on Large installation system administration
Job-scheduling via resource availability prediction for volunteer computational grids
International Journal of Grid and Utility Computing
On/off-line prediction applied to job scheduling on non-dedicated NOWs
Journal of Computer Science and Technology - Special issue on natural language processing
Server-side I/O coordination for parallel file systems
Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
Execution environments and benchmarks for the study of applications’ scheduling on clusters
ICA3PP'05 Proceedings of the 6th international conference on Algorithms and Architectures for Parallel Processing
A space and time sharing scheduling approach for PVM non-dedicated clusters
PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Long-term availability prediction for groups of volunteer resources
Journal of Parallel and Distributed Computing
Improving speedup and response times by replicating parallel programs on a SNOW
JSSPP'04 Proceedings of the 10th international conference on Job Scheduling Strategies for Parallel Processing
ISPA'04 Proceedings of the Second international conference on Parallel and Distributed Processing and Applications
CISNE: a new integral approach for scheduling parallel applications on non-dedicated clusters
Euro-Par'05 Proceedings of the 11th international Euro-Par conference on Parallel Processing
Concurrent execution of multiple NAS parallel programs on a cluster
ICCS'05 Proceedings of the 5th international conference on Computational Science - Volume Part I
Future Generation Computer Systems
Energy efficiency for large-scale MapReduce workloads with significant interactive analysis
Proceedings of the 7th ACM european conference on Computer Systems
Scheduling the interactions of multiple parallel jobs and sequential jobs on a non-dedicated cluster
ICCSA'05 Proceedings of the 2005 international conference on Computational Science and Its Applications - Volume Part IV
Towards a volunteer cloud architecture
EPEW'12 Proceedings of the 9th European conference on Computer Performance Engineering
Towards a volunteer cloud architecture
EPEW'12 Proceedings of the 9th European conference on Computer Performance Engineering
Demand-based coordinated scheduling for SMP VMs
Proceedings of the eighteenth international conference on Architectural support for programming languages and operating systems
Journal of Parallel and Distributed Computing
Hi-index | 0.00 |
This paper examines the plausibility of using a network of workstations (NOW) for a mixture of parallel and sequential jobs. Through simulations, our study examines issues that arise when combining these two workloads on a single platform. Starting from a dedicated NOW just for parallel programs, we incrementally relax uniprogramming restrictions until we have a multi-programmed, multi-user NOW for both interactive sequential users and parallel programs. We show that a number of issues associated with the distributed NOW environment (e.g., daemon activity, coscheduling skew) can have a small but noticeable effect on parallel program performance. We also find that efficient migration to idle workstations is necessary to maintain acceptable parallel application performance. Furthermore, we present a methodology for deriving an optimal delay time for recruiting idle machines for use by parallel programs; this recruitment threshold was just 3 minutes for the research cluster we measured. Finally, we quantify the effects of the additional parallel load upon interactive users by keeping track of the potential number of user delays in our simulations. When we limit the maximum number of delays per user, we can still maintain acceptable parallel program performance. In summary, we find that for our workloads a 2:1 rule applies: a NOW cluster of approximately 60 machines can sustain a 32-node parallel workload in addition to the sequential load placed upon it by interactive users.