Andrew: a distributed personal computing environment
Communications of the ACM - The MIT Press scientific computation series
The galley parallel file system
ICS '96 Proceedings of the 10th international conference on Supercomputing
Replication, consistency, and practicality: are these mutually exclusive?
SIGMOD '98 Proceedings of the 1998 ACM SIGMOD international conference on Management of data
GASS: a data movement and access service for wide area computing systems
Proceedings of the sixth workshop on I/O in parallel and distributed systems
Grids as Production Computing Environments: The Engineering Aspects of NASA's Information Power Grid
HPDC '99 Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing
Optimizing Scientific Databases for Client Side Data Processing
EDBT '02 Proceedings of the 8th International Conference on Extending Database Technology: Advances in Database Technology
A Unified Peer-to-Peer Database Framework for Scalable Service and Resource Discovery
GRID '02 Proceedings of the Third International Workshop on Grid Computing
DYNAMO - DirectorY, Net Archiver and MOver
GRID '02 Proceedings of the Third International Workshop on Grid Computing
Using Disk Throughput Data in Predictions of End-to-End Grid Data Transfers
GRID '02 Proceedings of the Third International Workshop on Grid Computing
Data Management for Grid Environments
HPCN Europe 2001 Proceedings of the 9th International Conference on High-Performance Computing and Networking
Predicting the Performance of Wide Area Data Transfers
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Scheduling in a Grid Computing Environment Using Genetic Algorithms
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Predicting Sporadic Grid Data Transfers
HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
MySRB & SRB: Components of a Data Grid
HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
Accurate Modeling of Cache Replacement Policies in a Data Grid
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
Data Grids, Collections, and Grid Bricks
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
Optimal Placement of Replicas in Data Grid Environments with Locality Assurance
ICPADS '06 Proceedings of the 12th International Conference on Parallel and Distributed Systems - Volume 1
A Uniform Parallel Optimization Method for Knowledge Discovery Grid
KES '08 Proceedings of the 12th international conference on Knowledge-Based Intelligent Information and Engineering Systems, Part II
RARS: a Resource-Aware Replica Selection and co-allocation scheme for mobile grid
International Journal of Ad Hoc and Ubiquitous Computing
Time and cost trade-off management for scheduling parallel applications on Utility Grids
Future Generation Computer Systems
Implementation of a medical image file accessing system in co-allocation data grids
Future Generation Computer Systems
Service Oriented Approach to High Performance Scientific Computing
CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
Scheduling parallel applications on utility grids: time and cost trade-off management
ACSC '09 Proceedings of the Thirty-Second Australasian Conference on Computer Science - Volume 91
Efficient data consolidation in grid networks and performance analysis
Future Generation Computer Systems
Dynamic replication in a data grid using a Modified BHR Region Based Algorithm
Future Generation Computer Systems
The Journal of Supercomputing
PHFS: A dynamic replication method, to decrease access latency in the multi-tier data grid
Future Generation Computer Systems
Network-aware heuristics for inter-domain meta-scheduling in Grids
Journal of Computer and System Sciences
Failure recovery mechanism in neighbor replica distribution architecture
ICICA'10 Proceedings of the First international conference on Information computing and applications
Journal of Systems and Software
Parallel and multi-wavelength downloading in optical grid networks
Photonic Network Communications
Digital virtual human based distance education system
CSCWD'04 Proceedings of the 8th international conference on Computer Supported Cooperative Work in Design I
A recursive-adjustment co-allocation scheme in data grid environments
ICA3PP'05 Proceedings of the 6th international conference on Algorithms and Architectures for Parallel Processing
A deadline and budget constrained scheduling algorithm for escience applications on data grids
ICA3PP'05 Proceedings of the 6th international conference on Algorithms and Architectures for Parallel Processing
Join algorithm using multiple replicas in data grid
WAIM'05 Proceedings of the 6th international conference on Advances in Web-Age Information Management
A semantics based information distribution framework for large web-based course forum system
ICWL'06 Proceedings of the 5th international conference on Advances in Web Based Learning
Simultaneous scheduling of replication and computation for bioinformatic applications on the grid
ISBMDA'05 Proceedings of the 6th International conference on Biological and Medical Data Analysis
Grid resource selection by application benchmarking for computational haemodynamics applications
ICCS'05 Proceedings of the 5th international conference on Computational Science - Volume Part I
Optimizing server placement in hierarchical grid environments
GPC'06 Proceedings of the First international conference on Advances in Grid and Pervasive Computing
Web service based data management for grid applications
EuroWeb'02 Proceedings of the 2002 international conference on EuroWeb
End-to-end quality of service for high-end applications
Computer Communications
QoS-aware replica placement for grid computing
Concurrency and Computation: Practice & Experience
UBIQUEST, for rapid prototyping of networking applications
Proceedings of the 16th International Database Engineering & Applications Sysmposium
Enhancing data replication with greedy pipeline-based aggressive copy protocol in data grids
ISPA'07 Proceedings of the 5th international conference on Parallel and Distributed Processing and Applications
Parallel database sort and join operations revisited on grids
HPCC'07 Proceedings of the Third international conference on High Performance Computing and Communications
An ontology-centric architecture for extensible scientific data management systems
Future Generation Computer Systems
Double auction-inspired meta-scheduling of parallel applications on global grids
Journal of Parallel and Distributed Computing
CAPM Indexed Hybrid E-Negotiation for Resource Allocation in Grid Computing
International Journal of Grid and High Performance Computing
Hopfield neural network for simultaneous job scheduling and data replication in grids
Future Generation Computer Systems
| Hi-index | 0.00 |
In this paper we report on preliminary work and architectural design carried out in the "Data Management" work package in the International Data Grid project. Our aim within a time scale of three years is to provide Grid middleware services supporting the I/O-intensive world-wide distributed next generation experiments in High-Energy Physics, Earth Observation and Bioinformatics. The goal is to specify, develop, integrate and test tools and middleware infrastructure to coherently manage and share Petabyte-range information volumes in high-throughput production-quality Grid environments. The middleware will allow secure access to massive amounts of data in a universal name-space, to move and replicate data at high speed from one geographical site to another, and to manage synchronisation of remote copies. We put much attention on clearly specifying and categorising existing work on the Grid, especially in data management in Grid related projects. Challenging use cases are described and how they map to architectural decisions concerning data access, replication, meta data management, security and query optimisation.