Experiences with 100Gbps network applications

Authors:
Mehmet Balman;Eric Pouyoul;Yushu Yao;E. Wes Bethel;Burlen Loring;Mr Prabhat;John Shalf;Alex Sim;Brian L. Tierney
Affiliations:
Lawrence Berkeley National Laboratory, Berkeley, CA, USA;Lawrence Berkeley National Laboratory, Berkeley, CA, USA;Lawrence Berkeley National Laboratory, Berkeley, CA, USA;Lawrence Berkeley National Laboratory, Berkeley, CA, USA;Lawrence Berkeley National Laboratoru, Berkeley, CA, USA;Lawrence Berkeley National Laboratoru, Berkeley, CA, USA;Lawrence Berkeley National Laboratoru, Berkeley, CA, USA;Lawrence Berkeley National Laboratoru, Berkeley, CA, USA;Lawrence Berkeley National Laboratory, Berkeley, CA, USA
Venue:
Proceedings of the fifth international workshop on Data-Intensive Distributed Computing Date
Year:
2012

Citing 9
Cited 0

The Globus Striped GridFTP Framework and Server

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
File grouping for scientific data management: lessons from experimenting with real traces

HPDC '08 Proceedings of the 17th international symposium on High performance distributed computing
Dynamically tuning level of parallelism in wide area data transfers

DADC '08 Proceedings of the 2008 international workshop on Data-aware distributed computing
Performance optimization of TCP/IP over 10 gigabit ethernet by precise instrumentation

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Efficient access to many samall files in a filesystem for grid computing

GRID '07 Proceedings of the 8th IEEE/ACM International Conference on Grid Computing
Sorting Reordered Packets with Interrupt Coalescing

Computer Networks: The International Journal of Computer and Telecommunications Networking
A Data Management Framework for Distributed Biomedical Research Environments

E-SCIENCEW '10 Proceedings of the 2010 Sixth IEEE International Conference on e-Science Workshops
Globus XIO pipe open driver: enabling GridFTP to leverage standard Unix tools

Proceedings of the 2011 TeraGrid Conference: Extreme Digital Discovery
Open problems in network-aware data management in exa-scale computing and terabit networking era

Proceedings of the first international workshop on Network-aware data management

Quantified Score

Hi-index	0.00

Visualization

Abstract

100Gbps networking has finally arrived, and many research and educational institutions have begun to deploy 100Gbps routers and services. ESnet and Internet2 worked together to make 100Gbps networks available to researchers at the Supercomputing 2011 conference in Seattle Washington. In this paper, we describe two of the first applications to take advantage of this network. We demonstrate a visualization application that enables remotely located scientists to gain insights from large datasets. We also demonstrate climate data movement and analysis over the 100Gbps network. We describe a number of application design issues and host tuning strategies necessary for enabling applications to scale to 100Gbps rates.