A worldwide flock of Condors: load sharing among workstation clusters
Future Generation Computer Systems - Special issue: resource management in distributed systems
The globus project: a status report
Future Generation Computer Systems - Special issue on metacomputing
Condor: a distributed job scheduler
Beowulf cluster computing with Linux
Peer-to-Peer: Harnessing the Power of Disruptive Technologies
Peer-to-Peer: Harnessing the Power of Disruptive Technologies
Programming Languages: Principles and Paradigms
Programming Languages: Principles and Paradigms
Condor-G: A Computation Management Agent for Multi-Institutional Grids
Cluster Computing
Chord: a scalable peer-to-peer lookup protocol for internet applications
IEEE/ACM Transactions on Networking (TON)
Job Scheduling Under the Portable Batch System
IPPS '95 Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing
Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems
Middleware '01 Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms Heidelberg
Resource Management through Multilateral Matchmaking
HPDC '00 Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing
Entropia: architecture and performance of an enterprise desktop grid system
Journal of Parallel and Distributed Computing - Special issue on computational grids
Heuristic scheduling for bag-of-tasks applications in combination with QoS in the computational grid
Future Generation Computer Systems - Special issue: Advanced grid technologies
Distributed computing in practice: the Condor experience: Research Articles
Concurrency and Computation: Practice & Experience - Grid Performance
Future Generation Computer Systems - Special issue: P2P computing and interaction with grids
Toward a Realistic Task Scheduling Model
IEEE Transactions on Parallel and Distributed Systems
Workflow-based grid applications
Future Generation Computer Systems
A self-organizing flock of Condors
Journal of Parallel and Distributed Computing
Designing a runtime system for volunteer computing
Proceedings of the 2006 ACM/IEEE conference on Supercomputing
Efficient task replication and management for adaptive fault tolerance in mobile Grid environments
Future Generation Computer Systems - Special section: Information engineering and enterprise architecture in distributed computing environments
Scheduling data-intensive bags of tasks in P2P grids with bittorrent-enabled data distribution
Proceedings of the second workshop on Use of P2P, GRID and agents for the development of content networks
A dependable Peer-to-Peer computing platform
Future Generation Computer Systems
Towards efficient data distribution on computational desktop grids with BitTorrent
Future Generation Computer Systems
Trade-offs in matching jobs and balancing load for distributed desktop grids
Future Generation Computer Systems
The MarineGrid project in Ireland with Webcom
Computers & Geosciences
WaveGrid: a scalable fast-turnaround heterogeneous peer-based desktop grid system
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Scalable architecture for allocation of idle CPUs in a p2p network
HPCC'06 Proceedings of the Second international conference on High Performance Computing and Communications
Globus toolkit version 4: software for service-oriented systems
NPC'05 Proceedings of the 2005 IFIP international conference on Network and Parallel Computing
Editorial: Special Section: Defining the grid, experiences and future trends
Future Generation Computer Systems
Distributed Radiotherapy Simulation with the Webcom Workflow System
International Journal of High Performance Computing Applications
Editorial: Special Section: P2P and internet computing
Future Generation Computer Systems
Future Generation Computer Systems
Hi-index | 0.00 |
This work presents the details of a model for fully decentralised scientific workflow management designed to support the efficient execution of applications in heterogeneous and unpredictable computing environments. The proposed model involves a novel application of the overlay metacomputer concept, built on a graph-oriented peer to peer framework. The use of peer to peer overlay on both batch and cycle scavenging systems simultaneously enables the aggregation and virtual homogenisation of heterogeneous resource collectives, and makes possible the execution of complex scientific workflow applications on otherwise batch oriented processors. Overlaying a peer to peer workflow management system on multiple independent sites decouples task expression from resource allocation, i.e., the host resource managers allocate processing elements to host the peers, allowing the peers execute multiple workflow tasks. This facilitates the efficient execution of very fine grained workflow expressions, which is shown to reduce both application makespan and wasted cycles when using processing elements allocated by a pre-emptive resource manager. Quantitative results are presented based on performance observed in a large scale heterogeneous multi-user environment.