Jcluster: an efficient Java parallel environment on a large-scale heterogeneous cluster: Research Articles

Authors:
Bao-Yin Zhang;Guang-Wen Yang;Wei-Min Zheng
Affiliations:
Institute of Applied Physics and Computational Mathematics, Beijing 100088, People's Republic of China;Department of Computer Science and Technology, Tsinghua University, Beijing 100084, People's Republic of China;Department of Computer Science and Technology, Tsinghua University, Beijing 100084, People's Republic of China
Venue:
Concurrency and Computation: Practice & Experience
Year:
2006

Citing 0
Cited 11

Java for high performance computing: assessment of current research and practice

PPPJ '09 Proceedings of the 7th International Conference on Principles and Practice of Programming in Java
A-JUMP, architecture for Java universal message passing

Proceedings of the 8th International Conference on Frontiers of Information Technology
A software tool for semi-automatic gridification of resource-intensive Java bytecodes and its application to ray tracing and sequence alignment

Advances in Engineering Software
On the evaluation of java symphony for heterogeneous multi-core clusters

Euro-Par 2010 Proceedings of the 2010 conference on Parallel processing
Scheduling javasymphony applications on many-core parallel computers

Euro-Par'11 Proceedings of the 17th international conference on Parallel processing - Volume Part I
Enhancing the BYG gridification tool with state-of-the-art Grid scheduling mechanisms and explicit tuning support

Advances in Engineering Software
F-MPJ: scalable Java message-passing communications on parallel systems

The Journal of Supercomputing
Device level communication libraries for high-performance computing in Java

Concurrency and Computation: Practice & Experience
Java in the High Performance Computing arena: Research, practice and experience

Science of Computer Programming
An object-oriented parallel programming language for distributed-memory parallel computing platforms

Science of Computer Programming
Energy-efficient job stealing for CPU-intensive processing in mobile devices

Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we present Jcluster, an efficient Java parallel environment that provides some critical services, in particular automatic load balancing and high-performance communication, for developing parallel applications in Java on a large-scale heterogeneous cluster. In the Jcluster environment, we implement a task scheduler based on a transitive random stealing (TRS) algorithm. Performance evaluations show that the scheduler based on TRS can make any idle node obtain a task from another node with much fewer stealing times than random stealing (RS), which is a well-known dynamic load-balancing algorithm, on a large-scale cluster. In the performance aspects of communication, with the method of asynchronously multithreaded transmission, we implement a high-performance PVM-like and MPI-like message-passing interface in pure Java. The evaluation of the communication performance is conducted among the Jcluster environment, LAM-MPI and mpiJava on LAM-MPI based on the Java Grande Forum's pingpong benchmark. Copyright © 2005 John Wiley & Sons, Ltd.