Distributing the Sloan Digital Sky Survey Using UDT and Sector

Authors:
Yunhong Gu;Robert L. Grossman;Alex Szalay;Ani Thakar
Affiliations:
University of Illinois at Chicago, USA;University of Illinois at Chicago, USA;The Johns Hopkins University, USA;The Johns Hopkins University, USA
Venue:
E-SCIENCE '06 Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
Year:
2006

Citing 0
Cited 8

Data mining using high performance data clouds: experimental studies using sector and sphere

Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining
Accelerating tropical cyclone analysis using LambdaRAM, a distributed data cache over wide-area ultra-fast networks

Future Generation Computer Systems
The quest for scalable support of data-intensive workloads in distributed systems

Proceedings of the 18th ACM international symposium on High performance distributed computing
Lessons learned from a year's worth of benchmarks of large data clouds

Proceedings of the 2nd Workshop on Many-Task Computing on Grids and Supercomputers
What is analytic infrastructure and why should you care?

ACM SIGKDD Explorations Newsletter
Sector: A high performance wide area community data storage and sharing system

Future Generation Computer Systems
Making a case for distributed file systems at Exascale

Proceedings of the third international workshop on Large-scale system and application performance
IKAROS: An HTTP-Based Distributed File System, for Low Consumption & Low Specification Devices

Journal of Grid Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we describe a peer-to-peer storage system called Sector that is designed to access and transport large data sets over wide area high performance networks. We also describe our recent experience using Sector to distribute the Sloan Digital Sky Survey BESTDR4 catalog data.