NetSolve: a network server for solving computational science problems
Supercomputing '96 Proceedings of the 1996 ACM/IEEE conference on Supercomputing
Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Ninf: A Network Based Information Library for Global World-Wide Computing Infrastructure
HPCN Europe '97 Proceedings of the International Conference and Exhibition on High-Performance Computing and Networking
A Scalable Approach to Network Enabled Servers (Research Note)
Euro-Par '02 Proceedings of the 8th International Euro-Par Conference on Parallel Processing
The internet backplane protocol: a study in resource sharing
Future Generation Computer Systems - Selected papers from CCGRID 2002
FRONTIERS '99 Proceedings of the The 7th Symposium on the Frontiers of Massively Parallel Computation
The Globus Project: A Status Report
HCW '98 Proceedings of the Seventh Heterogeneous Computing Workshop
Adaptive Online Data Compression
HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
Efficient End to End Data Exchange Using Configurable Compression
ICDCS '04 Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS'04)
HPDC '04 Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing
Parallel sparse linear solver GMRES for GPU clusters with compression of exchanged data
Euro-Par'11 Proceedings of the 2011 international conference on Parallel Processing
| Hi-index | 0.00 |
In this article, we present the AdOC (Adaptive Online Compression) library. It is a user-level set of functions that enables data transmission with compression. The compression is performed dynamically during the transmission and the compression level is constantly adapted according to the environment. In order to ease the integration of AdOC into existing software the API is very close to the read and write UNIX system calls and respects their semantic. Moreover this library is thread-safe and is ported to many UNIXlike systems. We have tested AdOC under various conditions and with various data types. Results show that the library outperforms the POSIX read/write system calls on a broad range of networks (up to 100 Mbit LAN), whereas on Gbit Ethernet, it provides similar performance.