Open problems in network-aware data management in exa-scale computing and terabit networking era

Authors:
Mehmet Balman;Surendra Byna
Affiliations:
Lawrence Berkeley National Laboratory, Berkeley, CA, USA;Lawrence Berkeley National Laboratory, Berkeley, CA, USA
Venue:
Proceedings of the first international workshop on Network-aware data management
Year:
2011

Citing 7
Cited 1

The Globus Striped GridFTP Framework and Server

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Performance optimization of TCP/IP over 10 gigabit ethernet by precise instrumentation

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Designing Efficient FTP Mechanisms for High Performance Data-Transfer over InfiniBand

ICPP '09 Proceedings of the 2009 International Conference on Parallel Processing
SoftRDMA: implementing iWARP over TCP kernel sockets

IBM Journal of Research and Development
A Flexible Reservation Algorithm for Advance Network Provisioning

Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
Globus Online: Accelerating and Democratizing Science through Cloud-Based Services

IEEE Internet Computing
Scientific data services: a high-performance I/O system with array semantics

Proceedings of the first annual workshop on High performance computing meets databases

Experiences with 100Gbps network applications

Proceedings of the fifth international workshop on Data-Intensive Distributed Computing Date

Quantified Score

Hi-index	0.00

Visualization

Abstract

Accessing and managing large amounts of data is a great challenge in collaborative computing environments where resources and users are geographically distributed. Recent advances in network technology led to next-generation high-performance networks, allowing high-bandwidth connectivity. Efficient use of the network infrastructure is necessary in order to address the increasing data and compute requirements of large-scale applications. We discuss several open problems, evaluate emerging trends, and articulate our perspectives in network-aware data management.