Scale and performance in a distributed file system
ACM Transactions on Computer Systems (TOCS)
A hierarchical access control scheme for digital libraries
Proceedings of the third ACM conference on Digital libraries
The Alexandria Digital Library Architecture
ECDL '98 Proceedings of the Second European Conference on Research and Advanced Technology for Digital Libraries
Adaptive performance prediction for distributed data-intensive applications
SC '99 Proceedings of the 1999 ACM/IEEE conference on Supercomputing
A novel application development environment for large-scale scientific computations
Proceedings of the 14th international conference on Supercomputing
Integrating parallel file I/O and database support for high-performance scientific data management
Proceedings of the 2000 ACM/IEEE conference on Supercomputing
HTTP redirection for replica catalogue lookups in data grids
Proceedings of the 2002 ACM symposium on Applied computing
Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Gathering at the well: creating communities for grid I/O
Proceedings of the 2001 ACM/IEEE conference on Supercomputing
LegionFS: a secure and scalable file system supporting cross-domain high-performance applications
Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Distributed computing research issues in grid computing
ACM SIGACT News
File and Object Replication in Data Grids
Cluster Computing
Data management and transfer in high-performance computational grid environments
Parallel Computing - Parallel data-intensive algorithms and applications
DYNAMO - DirectorY, Net Archiver and MOver
GRID '02 Proceedings of the Third International Workshop on Grid Computing
Exposed vs. Encapsulated Approaches to Grid Service Archtecture
GRID '01 Proceedings of the Second International Workshop on Grid Computing
Using Disk Throughput Data in Predictions of End-to-End Grid Data Transfers
GRID '02 Proceedings of the Third International Workshop on Grid Computing
Improving the Throughput of Remote Storage Access through Pipelining
GRID '02 Proceedings of the Third International Workshop on Grid Computing
Logistical Storage Resources for the Grid
ICCS '02 Proceedings of the International Conference on Computational Science-Part II
Data and Metadata Collections for Scientific Applications
HPCN Europe 2001 Proceedings of the 9th International Conference on High-Performance Computing and Networking
The End-to-End Performance Effects of Parallel TCP Sockets on a Lossy Wide-Area Network
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
A Scientific Data Management System for Irregular Applications
IPDPS '01 Proceedings of the 15th International Parallel & Distributed Processing Symposium
The Logistical Backbone: Scalable Infrastructure for Global Data Grids
ASIAN '02 Proceedings of the7th Asian Computing Science Conference on Advances in Computing Science: Internet Computing and Modeling, Grid Computing, Peer-to-Peer Computing, and Cluster
Access Time Estimation for Tertiary Storage Systems
Euro-Par '02 Proceedings of the 8th International Euro-Par Conference on Parallel Processing
Giggle: a framework for constructing scalable replica location services
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
The effects of systemic packet loss on aggregate TCP flows
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Interoperable Web services for computational portals
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
The internet backplane protocol: a study in resource sharing
Future Generation Computer Systems - Selected papers from CCGRID 2002
Predicting Sporadic Grid Data Transfers
HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
Flexibility, Manageability, and Performance in a Grid Storage Appliance
HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
MySRB & SRB: Components of a Data Grid
HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
A Simple Mass Storage System for the SRB Data Grid
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
Data Grids, Collections, and Grid Bricks
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
High-performance scientific data management system
Journal of Parallel and Distributed Computing
The Telescience Portal for advanced tomography applications
Journal of Parallel and Distributed Computing - Special issue on computational grids
Global telescience featuring IPv6 at iGrid2002
Future Generation Computer Systems - iGrid 2002
Data integration in a bandwidth-rich world
Communications of the ACM - Blueprint for the future of high-performance networking
Parallel Computing - Special issue: High performance computing with geographical data
A distributed multi-storage I/O system for data intensive scientific computing
Parallel Computing - Special issue: Parallel and distributed scientific and engineering computing
Grid resource management
A survey of life sciences applications on the grid
New Generation Computing - Grid systems for life sciences
Data pipelines: enabling large scale multi-protocol data transfers
MGC '04 Proceedings of the 2nd workshop on Middleware for grid computing
Communications of the ACM - Bioinformatics
Grid metadata catalog service-based OGC web registry service
Proceedings of the 12th annual ACM international workshop on Geographic information systems
Interactive Exploration of Large Remote Micro-CT Scans
VIS '04 Proceedings of the conference on Visualization '04
A high-performance distributed parallel file system for data-intensive computations
Journal of Parallel and Distributed Computing
A Peer-to-Peer Replica Location Service Based on a Distributed Hash Table
Proceedings of the 2004 ACM/IEEE conference on Supercomputing
A Metadata Catalog Service for Data Intensive Applications
Proceedings of the 2003 ACM/IEEE conference on Supercomputing
Enhancing grid capabilities: IBP over IPv6
Future Generation Computer Systems - Special issue: Advanced grid technologies
Future Generation Computer Systems
The Anatomy of the Grid: Enabling Scalable Virtual Organizations
International Journal of High Performance Computing Applications
The Design of Discovery Net: Towards Open Grid Services for Knowledge Discovery
International Journal of High Performance Computing Applications
Using Regression Techniques to Predict Large Data Transfers
International Journal of High Performance Computing Applications
Scalable Bulk Data Transfer in Wide Area Networks
International Journal of High Performance Computing Applications
Identity Boxing: A New Technique for Consistent Global Identity
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Separating Abstractions from Resources in a Tactical Storage System
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
A framework for reliable and efficient data placement in distributed computing systems
Journal of Parallel and Distributed Computing - Special issue: Design and performance of networks for super-, cluster-, and grid-computing: Part I
LTCP: improving the performance of TCP in highspeed networks
ACM SIGCOMM Computer Communication Review
A taxonomy of Data Grids for distributed data sharing, management, and processing
ACM Computing Surveys (CSUR)
BioSimGrid: grid-enabled biomolecular simulation data storage and analysis
Future Generation Computer Systems - Collaborative and learning applications of grid technology
KidneyGrid: a grid platform for integration of distributed kidney models and resources
Proceedings of the 4th international workshop on Middleware for grid computing
NFSv4 replication for grid storage middleware
Proceedings of the 4th international workshop on Middleware for grid computing
The Grid Resource Broker, a ubiquitous grid computing framework
Scientific Programming
New techniques for ensuring the long term integrity of digital archives
dg.o '07 Proceedings of the 8th annual international conference on Digital government research: bridging disciplines & domains
Wide Area Data Replication for Scientific Collaborations
GRID '05 Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing
Legacy Code Support for Production Grids
GRID '05 Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing
A brokerage system for solar data archives
Software—Practice & Experience
Direct-pNFS: scalable, transparent, and versatile access to parallel file systems
Proceedings of the 16th international symposium on High performance distributed computing
Management and preservation of research data with iRODS
Proceedings of the ACM first workshop on CyberInfrastructure: information management in eScience
Gridification and virtualization: enabling e-Science in the life sciences
Proceedings of the 15th ACM Mardi Gras conference: From lightweight mash-ups to lambda grids: Understanding the spectrum of distributed computing requirements, applications, tools, infrastructures, interoperability, and the incremental adoption of key capabilities
Proceedings of the 2008 ACM symposium on Applied computing
Improving GridFTP transfers by means of a multiagent parallel file system
Multiagent and Grid Systems - Grid Computing, high performance and distributed applications
A three tier architecture applied to LiDAR processing and monitoring
Scientific Programming - Scientific Workflows
Optimizing workflow data footprint
Scientific Programming - Dynamic Computational Workflows: Discovery, Optimization and Scheduling
Proceedings of the 8th ACM/IEEE-CS joint conference on Digital libraries
Grid services for e-archaeology
AusGrid '08 Proceedings of the sixth Australasian workshop on Grid computing and e-research - Volume 82
A Uniform Parallel Optimization Method for Knowledge Discovery Grid
KES '08 Proceedings of the 12th international conference on Knowledge-Based Intelligent Information and Engineering Systems, Part II
Gridscape II: An extensible grid monitoring portal architecture and its integration with Google Maps
International Journal of Parallel, Emergent and Distributed Systems - Best Papers from the GCC 2006 Conference
Generalizing the data management of three community grids
Future Generation Computer Systems
Managing Very-Large Distributed Datasets
OTM '08 Proceedings of the OTM 2008 Confederated International Conferences, CoopIS, DOA, GADA, IS, and ODBASE 2008. Part I on On the Move to Meaningful Internet Systems:
A Scavenger Grid for Intranet Indexing
ICADL 08 Proceedings of the 11th International Conference on Asian Digital Libraries: Universal and Ubiquitous Access to Information
A new paradigm: Data-aware scheduling in grid computing
Future Generation Computer Systems
Rule-based curation and preservation of data: A data grid approach using iRODS
Future Generation Computer Systems
Efficient access to many samall files in a filesystem for grid computing
GRID '07 Proceedings of the 8th IEEE/ACM International Conference on Grid Computing
Operating System Support for Space Allocation in Grid Storage Systems
GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Grid Deployment of Legacy Bioinformatics Applications with Transparent Data Access
GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Architecture for a Secure Distributed Repository
GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Enabling Ad Hoc Queries over Low-Level Scientific Data Sets
SSDBM 2009 Proceedings of the 21st International Conference on Scientific and Statistical Database Management
MetaFa: Metadata Management Framework for Data Sharing in Data-Intensive Applications
IWANN '09 Proceedings of the 10th International Work-Conference on Artificial Neural Networks: Part II: Distributed Computing, Artificial Intelligence, Bioinformatics, Soft Computing, and Ambient Assisted Living
Fine-Grain Access Control Using Shibboleth for the Storage Resource Broker
ISA '09 Proceedings of the 3rd International Conference and Workshops on Advances in Information Security and Assurance
Two-layered metadata service model in grid environment
International Journal of High Performance Computing and Networking
A uniform parallel optimization method for data mining grid
First International Workshop on Artificial Intelligence in Grid Computing
Semantic enabled metadata management in PetaShare
International Journal of Grid and Utility Computing
Distributed data access/find system with metadata for data-intensive computing
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
An ActOn-based semantic information service for Grids
Future Generation Computer Systems
Future Generation Computer Systems
BioSimGrid: Grid-enabled biomolecular simulation data storage and analysis
Future Generation Computer Systems - Collaborative and learning applications of grid technology
A high performance suite of data services for grids
Future Generation Computer Systems
A high-performance virtual storage system for Taiwan UniGrid
GPC'07 Proceedings of the 2nd international conference on Advances in grid and pervasive computing
Efficient synchronization of replicated data in distributed systems
ICCS'03 Proceedings of the 1st international conference on Computational science: PartI
Keyword based indexing and searching over storage resource broker
OTM'07 Proceedings of the 2007 OTM confederated international conference on On the move to meaningful internet systems: CoopIS, DOA, ODBASE, GADA, and IS - Volume Part II
Data grid model based on structured P2P overlay network
APPT'07 Proceedings of the 7th international conference on Advanced parallel processing technologies
Transparent on-demand co-allocation data access for grids
International Journal of Ad Hoc and Ubiquitous Computing
A hybrid distributed architecture for indexing
ECDL'09 Proceedings of the 13th European conference on Research and advanced technology for digital libraries
Journal of Systems and Software
A data placement strategy in scientific cloud workflows
Future Generation Computer Systems
Implementation of a medical image file accessing system in co-allocation data grids
Future Generation Computer Systems
ROARS: a scalable repository for data intensive scientific computing
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
GatorShare: a file system framework for high-throughput data management
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
A virtual laboratory for medical image analysis
IEEE Transactions on Information Technology in Biomedicine
First principles vulnerability assessment
Proceedings of the 2010 ACM workshop on Cloud computing security workshop
Parameter Sweep Workflows for Modelling Carbohydrate Recognition
Journal of Grid Computing
Elastic Cloud Caches for Accelerating Service-Oriented Computations
Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
A data management system for UNICORE 6
Euro-Par'09 Proceedings of the 2009 international conference on Parallel processing
DiST: fully decentralized indexing for querying distributed multidimensional datasets
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
MPI-IO/L: efficient remote I/O for MPI-IO via logistical networking
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
ISPDC'03 Proceedings of the Second international conference on Parallel and distributed computing
Velo: riding the knowledge management wave for simulation and modeling
Proceedings of the 4th International Workshop on Software Engineering for Computational Science and Engineering
Implementation of a distributed file storage with replica management in Peer-to-Peer environments
International Journal of Ad Hoc and Ubiquitous Computing
iRODS policy sets as standards for preservation
Proceedings of the 2010 Roadmap for Digital Preservation Interoperability Framework Workshop
Monitoring distributed collections using the Audit Control Environment (ACE)
Proceedings of the 2010 Roadmap for Digital Preservation Interoperability Framework Workshop
SEERDIS: a DHT-based resource indexing and discovery scheme for the data center
Proceedings of the 19th High Performance Computing Symposia
Gvu: a view-oriented framework for data management in grid environments
HiPC'06 Proceedings of the 13th international conference on High Performance Computing
Versioning and consistency in replica systems
ISPA'06 Proceedings of the 2006 international conference on Frontiers of High Performance Computing and Networking
Data access time estimation for the CASTOR HSM system
PPAM'05 Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics
A framework for data management and transfer in grid environments
EUC'06 Proceedings of the 2006 international conference on Embedded and Ubiquitous Computing
An efficient data management system with high scalability for chinagrid support platform
APPT'05 Proceedings of the 6th international conference on Advanced Parallel Processing Technologies
A deadline and budget constrained scheduling algorithm for escience applications on data grids
ICA3PP'05 Proceedings of the 6th international conference on Algorithms and Architectures for Parallel Processing
2-layered metadata service model in grid environment
ICA3PP'05 Proceedings of the 6th international conference on Algorithms and Architectures for Parallel Processing
Data-Driven power system operations
ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part III
Replica based distributed metadata management in grid environment
ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part IV
Time based congestion control (TBCC) for high speed high delay networks
ICIC'06 Proceedings of the 2006 international conference on Intelligent Computing - Volume Part I
RRS: replica registration service for data grids
DMG 2005 Proceedings of the First VLDB conference on Data Management in Grids
Analyzing design choices for distributed multidimensional indexing
The Journal of Supercomputing
A parallel data storage interface to GridFTP
ODBASE'06/OTM'06 Proceedings of the 2006 Confederated international conference on On the Move to Meaningful Internet Systems: CoopIS, DOA, GADA, and ODBASE - Volume Part II
Metadata catalogs with semantic representations
IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
Grid workflow software for a high-throughput proteome annotation pipeline
LSGRID'04 Proceedings of the First international conference on Life Science Grid
An autonomic framework for enhancing the quality of data grid services
Future Generation Computer Systems
Evolution of grid-based services for Diffusion Tensor Image analysis
Future Generation Computer Systems
Automated tracing and visualization of software security structure and properties
Proceedings of the Ninth International Symposium on Visualization for Cyber Security
ROARS: a robust object archival system for data intensive scientific computing
Distributed and Parallel Databases
An ontology-centric architecture for extensible scientific data management systems
Future Generation Computer Systems
G2G: A Meta-Grid Framework for the Convergence of P2P and Grids
International Journal of Grid and High Performance Computing
A system for managing data provenance in in silico experiments
ADC '11 Proceedings of the Twenty-Second Australasian Database Conference - Volume 115
International Journal of Information and Communication Technology
A framework for user driven data management
Information Systems
| Hi-index | 0.00 |
This paper describes the architecture of the SDSC Storage Resource Broker (SRB). The SRB is middleware that provides applications a uniform API to access heterogeneous distributed storage resources including, filesystems, database systems, and archival storage systems. The SRB utilizes a metadata catalog service, MCAT, to provide a "collection"- oriented view of data. Thus, data items that belong to a single collection may, in fact, be stored on heterogeneous storage systems. The SRB infrastructure is being used to support digital library projects at SDSC. This paper describes the architecture and various features of the SDSC SRB.