Bro: a system for detecting network intruders in real-time
Computer Networks: The International Journal of Computer and Telecommunications Networking
Grid-Distributed Visualizations Using Connectionless Protocols
IEEE Computer Graphics and Applications
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
System capability effects on algorithms for network bandwidth measurement
Proceedings of the 3rd ACM SIGCOMM conference on Internet measurement
On-Demand Grid Application Tuning and Debugging with the NetLogger Activation Service
GRID '03 Proceedings of the 4th International Workshop on Grid Computing
Storage resource managers: essential components for the Grid
Grid resource management
Network system design affects distributed parallel computing
InfoScale '06 Proceedings of the 1st international conference on Scalable information systems
Sector: A high performance wide area community data storage and sharing system
Future Generation Computer Systems
Lossless compression for large scale cluster logs
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
A load-aware data placement policy on cluster file system
NPC'11 Proceedings of the 8th IFIP international conference on Network and parallel computing
| Hi-index | 0.00 |
Increasingly, scientific advances require the fusion of large amounts of complex data with extraordinary amounts of computational power. The problems of deep science demand deep computing and deep storage resources. In addition to teraflop-range computing engines with their own local storage, facilities must provide large data repositories of the order of 10-100 petabytes, and networking to allow the movement of multi-terabyte files in a timely and secure manner. This paper examines such problems and identifies associated challenges. The paper discusses some of the storage systems and data management methods that are needed for computing facilities to address the challenges and describes some ongoing improvements.