End-to-end arguments in system design
ACM Transactions on Computer Systems (TOCS)
OceanStore: an architecture for global-scale persistent storage
ASPLOS IX Proceedings of the ninth international conference on Architectural support for programming languages and operating systems
Chord: A scalable peer-to-peer lookup service for internet applications
Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications
Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility
SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
Wide-area cooperative storage with CFS
SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
Globally Distributed Content Delivery
IEEE Internet Computing
An end-to-end approach to globally scalable network storage
Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications
Deep scientific computing requires deep data
IBM Journal of Research and Development
A Peer-to-Peer Replica Location Service Based on a Distributed Hash Table
Proceedings of the 2004 ACM/IEEE conference on Supercomputing
Awarded Best Student Paper! - Pond: The OceanStore Prototype
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
Distributing the Sloan Digital Sky Survey Using UDT and Sector
E-SCIENCE '06 Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
UDT: UDP-based data transfer for high-speed wide area networks
Computer Networks: The International Journal of Computer and Telecommunications Networking
Wide Area Data Replication for Scientific Collaborations
GRID '05 Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing
RobuSTore: a distributed storage architecture with robust and high performance
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Globus toolkit version 4: software for service-oriented systems
NPC'05 Proceedings of the 2005 IFIP international conference on Network and Parallel Computing
Editorial: Special section: Peer-to-peer grid technologies
Future Generation Computer Systems
Identity-based data storage in cloud computing
Future Generation Computer Systems
In-network redundancy generation for opportunistic speedup of data backup
Future Generation Computer Systems
| Hi-index | 0.00 |
We introduce Sector, a system that provides data storage and sharing services over high performance wide area networks. There is now a critical need for such systems, given the rapidly increasing sizes of scientific datasets. Meanwhile, developing such systems is becoming practical because of the rapid growth of optical networks. The goal of Sector is to serve a community where users can upload and store large datasets, easily share their data with others, and perform distributed data processing over it using a very simple API. Sector uses a peer-to-peer routing mechanism to organize the participating nodes. Sector servers provide very simple and basic functions for storing, locating, and accessing data. Users can use a Sector client to access data or use the Sector client API to write distributed applications. We have successfully used Sector to store and distribute various products from Sloan Digital Sky Survey (SDSS) to astronomers around the world.