Integration of compute-intensive tasks into scientific workflows in beesycluster

Authors:
Paweł Czarnul
Affiliations:
Faculty of Electronics, Telecommunications and Informatics, Gdansk University of Technology, Poland
Venue:
ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part III
Year:
2006

Citing 4
Cited 2

Triana: A Graphical Web Service Composition and Execution Toolkit

ICWS '04 Proceedings of the IEEE International Conference on Web Services
Scientific workflow management and the Kepler system: Research Articles

Concurrency and Computation: Practice & Experience - Workflow in Grid Systems
Remote task submission and publishing in beesycluster: security and efficiency of web service interface

PPAM'05 Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics
New user-guided and ckpt-based checkpointing libraries for parallel MPI applications,

PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface

BC-MPI: running an MPI application on multiple clusters with BeesyCluster connectivity

PPAM'07 Proceedings of the 7th international conference on Parallel processing and applied mathematics
BeesyBees: A mobile agent-based middleware for a reliable and secure execution of service-based workflow applications in BeesyCluster

Multiagent and Grid Systems - Agent Based Computing: From Model to Implementation

Quantified Score

Hi-index	0.02

Visualization

Abstract

The paper presents design, implementation details and simulations of scientific workflows involving compute-intensive tasks on clusters and PCs. The author has incorporated support for scientific workflows into previously developed J2EE-based BeesyCluster, deployed at Academic Computer Center Gdansk Poland on large HPC resources including a large 288-processor Itanium2 cluster. BeesyCluster allows users to manage various accounts on clusters/PCs via WWW/Web Services, run shell interactively, compile, queue, run tasks, publish services for other users, work in teams. A frequent scenario in HPC computing is analyzed, in which a workflow is combined from tasks offered by different users. Steps of the workflow include data preparation and following simulations run in parallel on clusters, with and without queuing systems.