The Virtual Interface Architecture
IEEE Micro
Pin-down Cache: A Virtual Memory Management Technique for Zero-copy Communication
IPPS '98 Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium
Ibis: a flexible and efficient Java-based Grid programming environment: Research Articles
Concurrency and Computation: Practice & Experience - 2002 ACM Java Grande–ISCOPE Conference Part II
Asynchronous Communication in Java over Infiniband and DECK
SBAC-PAD '05 Proceedings of the 17th International Symposium on Computer Architecture on High Performance Computing
An evaluation of Java for numerical computing
Scientific Programming
Jdib: Java Applications Interface to Unshackle the Communication Capabilities of InfiniBand Networks
NPC '07 Proceedings of the 2007 IFIP International Conference on Network and Parallel Computing Workshops
A Performance Study of Java Communication Stacks over InfiniBand and Giga-bit Ethernet
NPC '07 Proceedings of the 2007 IFIP International Conference on Network and Parallel Computing Workshops
Enabling RDMA Capability of InfiniBand Network for Java Applications
NAS '08 Proceedings of the 2008 International Conference on Networking, Architecture, and Storage
Java Fast Sockets: Enabling high-speed Java communications on high performance clusters
Computer Communications
Nested parallelism for multi-core HPC systems using Java
Journal of Parallel and Distributed Computing
NPB-MPJ: NAS Parallel Benchmarks Implementation for Message-Passing in Java
PDP '09 Proceedings of the 2009 17th Euromicro International Conference on Parallel, Distributed and Network-based Processing
uStream: A User-Level Stream Protocol over Infiniband
ICPADS '09 Proceedings of the 2009 15th International Conference on Parallel and Distributed Systems
MPJ express meets gadget: towards a java code for cosmological simulations
EuroPVM/MPI'06 Proceedings of the 13th European PVM/MPI User's Group conference on Recent advances in parallel virtual machine and message passing interface
MPJ/Ibis: a flexible and efficient message passing platform for java
PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
F-MPJ: scalable Java message-passing communications on parallel systems
The Journal of Supercomputing
Device level communication libraries for high-performance computing in Java
Concurrency and Computation: Practice & Experience
Java in the High Performance Computing arena: Research, practice and experience
Science of Computer Programming
Hi-index | 0.00 |
This paper presents ibvdev a scalable and efficient low-level Java message-passing communication device over InfiniBand. The continuous increase in the number of cores per processor underscores the need for efficient communication support for parallel solutions. Moreover, current system deployments are aggregating a significant number of cores through advanced network technologies, such as InfiniBand, increasing the complexity of communication protocols, especially when dealing with hybrid shared/distributed memory architectures such as clusters. Here, Java represents an attractive choice for the development of communication middleware for these systems, as it provides built-in networking and multithreading support. As the gap between Java and compiled languages performance has been narrowing for the last years, Java is an emerging option for High Performance Computing (HPC).The developed communication middleware ibvdev increases Java applications performance on clusters of multicore processors interconnected via InfiniBand through: (1) providing Java with direct access to InfiniBand using InfiniBand Verbs API, somewhat restricted so far to MPI libraries; (2) implementing an efficient and scalable communication protocol which obtains start-up latencies and bandwidths similar to MPI performance results; and (3) allowing its integration in any Java parallel and distributed application. In fact, it has been successfully integrated in the Java messaging library MPJ Express.The experimental evaluation of this middleware on an InfiniBand cluster of multicore processors has shown significant point-to-point performance benefits, up to 85% start-up latency reduction and twice the bandwidth compared to previous Java middleware on InfiniBand. Additionally, the impact of ibvdev on message-passing collective operations is significant, achieving up to one order of magnitude performance increases compared to previous Java solutions, especially when combined with multithreading. Finally, the efficiency of this middleware, which is even competitive with MPI in terms of performance, increments the scalability of communications intensive Java HPC applications.