Phoenix: a parallel programming model for accommodating dynamically joining/leaving resources
Proceedings of the ninth ACM SIGPLAN symposium on Principles and practice of parallel programming
The Second Trans-Pacific Grid Datafarm Testbed and Experiments for SC2003
SAINT-W '04 Proceedings of the 2004 Symposium on Applications and the Internet-Workshops (SAINT 2004 Workshops)
Parallel and Distributed Astronomical Data Analysis on Grid Datafarm
GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
A taxonomy of Data Grids for distributed data sharing, management, and processing
ACM Computing Surveys (CSUR)
Direct-pNFS: scalable, transparent, and versatile access to parallel file systems
Proceedings of the 16th international symposium on High performance distributed computing
Intelligent data staging with overlapped execution of grid applications
Future Generation Computer Systems
A parallel method for large sparse generalized eigenvalue problems using a GridRPC system
Future Generation Computer Systems
BitDew: a programmable environment for large-scale data management and distribution
Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
Performance Evaluation of Data Management Layer by Data Sharing Patterns for Grid RPC Applications
Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
Distributed Management of Massive Data: An Efficient Fine-Grain Data Access Scheme
High Performance Computing for Computational Science - VECPAR 2008
Global-scale peer-to-peer file services with DFS
GRID '07 Proceedings of the 8th IEEE/ACM International Conference on Grid Computing
Multi-Replication with Intelligent Staging in Data-Intensive Grid Applications
GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Replicated data management in the grid: the Re:GRIDiT approach
Proceedings of the 1st ACM workshop on Data grids for eScience
Journal of Network and Computer Applications
Toward a Catalogue of Architectural Bad Smells
QoSA '09 Proceedings of the 5th International Conference on the Quality of Software Architectures: Architectures for Adaptive Software Systems
Improving Parallel Write by Node-Level Request Scheduling
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
File Clustering Based Replication Algorithm in a Grid Environment
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Handling Persistent States in Process Checkpoint/Restart Mechanisms for HPC Systems
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Access-pattern and bandwidth aware file replication algorithm in a grid environment
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
VisageFS dynamic storage features for wide-area workflows
PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
A high performance suite of data services for grids
Future Generation Computer Systems
Transparent on-demand co-allocation data access for grids
International Journal of Ad Hoc and Ubiquitous Computing
File-Access Characteristics of Data-Intensive Workflow Applications
CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Accelerating parallel analysis of scientific simulation data via Zazen
FAST'10 Proceedings of the 8th USENIX conference on File and storage technologies
BlobSeer: Next-generation data management for large scale infrastructures
Journal of Parallel and Distributed Computing
A run-time system for efficient execution of scientific workflows on distributed environments
International Journal of Parallel Programming
A survey of dynamic replication strategies for improving data availability in data grids
Future Generation Computer Systems
Gvu: a view-oriented framework for data management in grid environments
HiPC'06 Proceedings of the 13th international conference on High Performance Computing
Integrating local job scheduler – LSFTM with GfarmTM
ISPA'05 Proceedings of the Third international conference on Parallel and Distributed Processing and Applications
ICCSA'10 Proceedings of the 2010 international conference on Computational Science and Its Applications - Volume Part IV
Performance improvement by data management layer in a grid RPC system
GPC'06 Proceedings of the First international conference on Advances in Grid and Pervasive Computing
Bridging HPC and grid file i/o with IOFSL
PARA'10 Proceedings of the 10th international conference on Applied Parallel and Scientific Computing - Volume 2
An autonomic framework for enhancing the quality of data grid services
Future Generation Computer Systems
Journal of Network and Computer Applications
International Journal of Information and Communication Technology
Zone-based data striping for cloud storage
IBM Journal of Research and Development
Dynamic replica placement and selection strategies in data grids- A comprehensive survey
Journal of Parallel and Distributed Computing
| Hi-index | 0.00 |
The Grid Datafarm (Gfarm) architecture is designed forglobal petascale data-intensive computing.It provides aglobal parallel filesystem with online petascale storage,scalable I/O bandwidth, and scalable parallel processing,and it can exploit local I/O in a grid of clusters with tensof thousands of nodes.Gfarm parallel I/O APIs and commands provide a single filesystem image and manipulatefilesystem metadata consistently.Fault tolerance and loadbalancing are automatically managed by file duplication orrecomputation using a command history log.Preliminaryperformance evaluation has shown scalable disk I/O andnetwork bandwidth on 64 nodes of the Presto III Athloncluster.The Gfarm parallel I/O write and read operationshas achieved data transfer rates of 1.74 GB/s and 1.97GB/s, respectively, using 64 cluster nodes.The Gfarm parallelfile copy reached 443 MB/s with 23 parallel streams on the Myrinet 2000.The Gfarm architecture is expected to enable petascale data-intensive Grid computing with an I/O bandwidth scales to the TB/s range and scalable computationalpower.