Implementing the beam and warming method on the hypercube
C3P Proceedings of the third conference on Hypercube concurrent computers and applications - Volume 2
Parallel file systems for the IBM SP computers
IBM Systems Journal
Serverless network file systems
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
PPFS: a high performance portable parallel file system
ICS '95 Proceedings of the 9th international conference on Supercomputing
The Vesta parallel file system
ACM Transactions on Computer Systems (TOCS)
The Galley parallel file system
Parallel Computing - Special double issue: parallel I/O
Experimental evaluation of the Hewlett-Parkard exemplar file system
ACM SIGMETRICS Performance Evaluation Review
On implementing MPI-IO portably and with high performance
Proceedings of the sixth workshop on I/O in parallel and distributed systems
The Coda Distributed File System
Linux Journal
Using MPI-2: Advanced Features of the Message Passing Interface
Using MPI-2: Advanced Features of the Message Passing Interface
A Framework for Adaptive Storage Input/Output on Computational Grids
Proceedings of the 11 IPPS/SPDP'99 Workshops Held in Conjunction with the 13th International Parallel Processing Symposium and 10th Symposium on Parallel and Distributed Processing
An Abstract-Device Interface for Implementing Portable Parallel-I/O Interfaces
FRONTIERS '96 Proceedings of the 6th Symposium on the Frontiers of Massively Parallel Computation
Data Sieving and Collective I/O in ROMIO
FRONTIERS '99 Proceedings of the The 7th Symposium on the Frontiers of Massively Parallel Computation
MPI-IO on a Parallel File System for Cluster of Workstations
IWCC '99 Proceedings of the 1st IEEE Computer Society International Workshop on Cluster Computing
Orthogonal Striping and Mirroring in Distributed RAID for I/O-Centric Cluster Computing
IEEE Transactions on Parallel and Distributed Systems
Performance analysis of MPI-I/O primitives on a PC cluster
Proceedings of the 2002 ACM symposium on Applied computing
Beowulf cluster computing with Linux
A case study in application I/O on Linux clusters
Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Parallel data intensive computing in scientific and commercial applications
Parallel Computing - Parallel data-intensive algorithms and applications
An Experimental Evaluation of I/O Optimizations on Different Applications
IEEE Transactions on Parallel and Distributed Systems
Learning from the Success of MPI
HiPC '01 Proceedings of the 8th International Conference on High Performance Computing
Large-Scale Scientific Irregular Computing on Clusters and Grids
ICCS '02 Proceedings of the International Conference on Computational Science-Part I
Mapping Functions and Data Redistribution for Parallel Files
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Parallel Incremental 2D-Discretization on Dynamic Datasets
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Performance Evaluation of I/O Traffic and Placement of I/O Nodes on a High Performance Network
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Efficient Manipulation of Large Datasets on Heterogeneous Storage Systems
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Irregular and Out-of-Core Parallel Computing on Clusters
PPAM '01 Proceedings of the th International Conference on Parallel Processing and Applied Mathematics-Revised Papers
Data Reservoir: utilization of multi-gigabit backbone network for data-intensive research
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Placement of I/O servers to improve parallel I/O performance on switch-based clusters
ICS '03 Proceedings of the 17th annual international conference on Supercomputing
A Scalable Architecture for Clustered Network Attached Storage
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
Future Generation Computer Systems - iGrid 2002
Applying Database Support for Large Scale Data Driven Science in Distributed Environments
GRID '03 Proceedings of the 4th International Workshop on Grid Computing
Use of PVFS for Efficient Execution of Jobs with Pipeline-Shared I/O
GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
Parallel and Distributed Astronomical Data Analysis on Grid Datafarm
GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
A high-performance distributed parallel file system for data-intensive computations
Journal of Parallel and Distributed Computing
A Self-Organizing Storage Cluster for Parallel Data-Intensive Applications
Proceedings of the 2004 ACM/IEEE conference on Supercomputing
An Efficient Data Location Protocol for Self.organizing Storage Clusters
Proceedings of the 2003 ACM/IEEE conference on Supercomputing
Distributed Scheduling of Parallel I/O in the Presence of Data Replication
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
Efficient Data Access for Parallel BLAST
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
BMI: A Network Abstraction Layer for Parallel I/O
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 9 - Volume 10
Distributed Storage Layout Schemes
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 16 - Volume 17
I/O performance of an RAID-10 style parallel file system
Journal of Computer Science and Technology
Design of a next generation sampling service for large scale data analysis applications
Proceedings of the 19th annual international conference on Supercomputing
High performance support of parallel virtual file system (PVFS2) over Quadrics
Proceedings of the 19th annual international conference on Supercomputing
FreeLoader: Scavenging Desktop Storage Resources for Scientific Data
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
A new formalism for dynamic reconfiguration of data servers in a cluster
Journal of Parallel and Distributed Computing - Special issue: Design and performance of networks for super-, cluster-, and grid-computing: Part I
Discretionary Caching for I/O on Clusters
Cluster Computing
A Storage Space Management Policy for a Cluster File System
HPCASIA '05 Proceedings of the Eighth International Conference on High-Performance Computing in Asia-Pacific Region
Energy-aware data prefetching for multi-speed disks
Proceedings of the 3rd conference on Computing frontiers
Optimizing I/O server placement for parallel I/O on switch-based irregular networks
The Journal of Supercomputing
CEFT: A cost-effective, fault-tolerant parallel virtual file system
Journal of Parallel and Distributed Computing
Adaptive parallel I/O scheduling algorithm for multiprogrammed systems
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
MAPFS: a flexible multiagent parallel file system for clusters
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
Home-based cooperative cache for parallel I/O applications
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
Data consistent up- and downstreaming in a distributed storage system
SNAPI '03 Proceedings of the international workshop on Storage network architecture and parallel I/Os
SNAPI '03 Proceedings of the international workshop on Storage network architecture and parallel I/Os
SNAPI '03 Proceedings of the international workshop on Storage network architecture and parallel I/Os
A parallel out-of-core computing system using PVFS for Linux clusters
SNAPI '04 Proceedings of the international workshop on Storage network architecture and parallel I/Os
Constructing collaborative desktop storage caches for large scientific datasets
ACM Transactions on Storage (TOS)
Scalable Design and Implementations for MPI Parallel Overlapping I/O
IEEE Transactions on Parallel and Distributed Systems
Proceedings of the 2006 ACM/IEEE conference on Supercomputing
The Design of New Journaling File Systems: The DualFS Case
IEEE Transactions on Computers
Recovering transient data: automated on-demand data reconstruction and offloading for supercomputers
ACM SIGOPS Operating Systems Review
RemoteFS: accessing remote file systems for desktop grid computing
Proceedings of the 2007 ACM symposium on Applied computing
Providing tunable consistency for a parallel file store
FAST'05 Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies - Volume 4
Grid-Oriented Storage: A Single-Image, Cross-Domain, High-Bandwidth Architecture
IEEE Transactions on Computers
Competitive prefetching for concurrent sequential I/O
Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007
Cooperative Client-Side File Caching for MPI Applications
International Journal of High Performance Computing Applications
Implementing MPI-IO Atomic Mode and Shared File Pointers Using MPI One-Sided Communication
International Journal of High Performance Computing Applications
Grid-Based Storage Architecture for Accelerating Bioinformatics Computing
Journal of VLSI Signal Processing Systems
ZOID: I/O-forwarding infrastructure for petascale architectures
Proceedings of the 13th ACM SIGPLAN Symposium on Principles and practice of parallel programming
Intelligent data staging with overlapped execution of grid applications
Future Generation Computer Systems
A case study of parallel I/O for biological sequence search on Linux clusters
International Journal of High Performance Computing and Networking
Evaluating structured I/O methods for parallel file systems
International Journal of High Performance Computing and Networking
Efficient Parallel I/O in Community Atmosphere Model (CAM)
International Journal of High Performance Computing Applications
Integrating parallel file systems with object-based storage devices
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Evaluation of active storage strategies for the lustre parallel file system
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
RobuSTore: a distributed storage architecture with robust and high performance
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Optimizing center performance through coordinated data staging, scheduling and recovery
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Experiences with a FPGA-based Reed/Solomon-encoding coprocessor
Microprocessors & Microsystems
High-performance land surface modeling with a Linux cluster
Computers & Geosciences
Striping without sacrifices: maintaining POSIX semantics in a parallel file system
LASCO'08 First USENIX Workshop on Large-Scale Computing
Parallel I/O prefetching using MPI file caching and I/O signatures
Proceedings of the 2008 ACM/IEEE conference on Supercomputing
A scalable parallel framework for analyzing terascale molecular dynamics simulation trajectories
Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Prefetch throttling and data pinning for improving performance of shared caches
Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Meeting the data challenge: curriculum development for parallel data systems
SIGITE '08 Proceedings of the 9th ACM SIGITE conference on Information technology education
Reducing Kernel Development Complexity in Distributed Environments
Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
Efficient Management of Complex Striped Files in Active Storage
Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
O2S2: enhanced object-based virtualized storage
ACM SIGOPS Operating Systems Review
Comparative evaluation of overlap strategies with study of I/O overlap in MPI-IO
ACM SIGOPS Operating Systems Review
Profiler and compiler assisted adaptive I/O prefetching for shared storage caches
Proceedings of the 17th international conference on Parallel architectures and compilation techniques
Configurable security for scavenged storage systems
Proceedings of the 4th ACM international workshop on Storage security and survivability
A Prefetching Algorithm for Multi-speed Disks
Transactions on High-Performance Embedded Architectures and Compilers I
The Journal of Supercomputing
Efficient access to many samall files in a filesystem for grid computing
GRID '07 Proceedings of the 8th IEEE/ACM International Conference on Grid Computing
Multi-Replication with Intelligent Staging in Data-Intensive Grid Applications
GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Extending virtualization services with trust guarantees via behavioral monitoring
Proceedings of the 1st EuroSys Workshop on Virtualization Technology for Dependable Systems
/scratch as a cache: rethinking HPC center scratch storage
Proceedings of the 23rd international conference on Supercomputing
DataStager: scalable data staging services for petascale applications
Proceedings of the 18th ACM international symposium on High performance distributed computing
Exploring data reliability tradeoffs in replicated storage systems
Proceedings of the 18th ACM international symposium on High performance distributed computing
Abstract storage: moving file format-specific abstractions intopetabyte-scale storage systems
Proceedings of the second international workshop on Data-aware distributed computing
Tashi: location-aware cluster management
ACDC '09 Proceedings of the 1st workshop on Automated control for datacenters and clouds
Improving Parallel Write by Node-Level Request Scheduling
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
MPISec I/O: Providing Data Confidentiality in MPI-I/O
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Access-pattern and bandwidth aware file replication algorithm in a grid environment
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
Conflict Detection Algorithm to Minimize Locking for MPI-IO Atomicity
Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Euro-Par '09 Proceedings of the 15th International Euro-Par Conference on Parallel Processing
Dynamic load balancing for I/O-intensive applications on clusters
ACM Transactions on Storage (TOS)
On the Need for a Consortium of Capability Centers
International Journal of High Performance Computing Applications
Symmetric active/active metadata service for high availability parallel file systems
Journal of Parallel and Distributed Computing
VisageFS dynamic storage features for wide-area workflows
PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
Symmetric active/active metadata service for highly available cluster storage systems
PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
I/O performance challenges at leadership scale
Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
BlobSeer: how to enable efficient versioning for large object storage under heavy access concurrency
Proceedings of the 2009 EDBT/ICDT Workshops
Adaptive parallel I/O scheduling algorithm for multiprogrammed systems
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
MAPFS: A flexible multiagent parallel file system for clusters
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
Home-based Cooperative Cache for parallel I/O applications
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
Mixing Hadoop and HPC workloads on parallel filesystems
Proceedings of the 4th Annual Workshop on Petascale Data Storage
Data layout optimization for petascale file systems
Proceedings of the 4th Annual Workshop on Petascale Data Storage
pNFS, POSIX, and MPI-IO: a tale of three semantics
Proceedings of the 4th Annual Workshop on Petascale Data Storage
Remote MPI-I/O on parallel virtual file system using a circular buffer for high throughput
International Journal of Computers and Applications
The case for a versatile storage system
ACM SIGOPS Operating Systems Review
ATTEST: ATTributes-based Extendable STorage
Journal of Systems and Software
Parallel I/O scheduling in multiprogrammed cluster computing systems
ICCS'03 Proceedings of the 2003 international conference on Computational science
A flexible multiagent parallel file system for clusters
ICCS'03 Proceedings of the 2003 international conference on Computational science
Metaserver locality and scalability in a distributed NFS
VECPAR'06 Proceedings of the 7th international conference on High performance computing for computational science
FPGA-accelerated deletion-tolerant coding for reliable distributed storage
ARCS'07 Proceedings of the 20th international conference on Architecture of computing systems
VECPAR'02 Proceedings of the 5th international conference on High performance computing for computational science
On business grid demands and approaches
GECON'07 Proceedings of the 4th international conference on Grid economics and business models
Self-provisioned hybrid clouds
Proceedings of the 7th international conference on Autonomic computing
Extensible block-level storage virtualization in cluster-based systems
Journal of Parallel and Distributed Computing
Virtual Organization Clusters: Self-provisioned clouds on the grid
Future Generation Computer Systems
DataStager: scalable data staging services for petascale applications
Cluster Computing
Computation mapping for multi-level storage cache hierarchies
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Cashing in on hints for better prefetching and caching in PVFS and MPI-IO
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
A layout-aware optimization strategy for collective I/O
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Black-box problem diagnosis in parallel file systems
FAST'10 Proceedings of the 8th USENIX conference on File and storage technologies
Accelerating parallel analysis of scientific simulation data via Zazen
FAST'10 Proceedings of the 8th USENIX conference on File and storage technologies
IOrchestrator: Improving the Performance of Multi-node I/O Systems via Inter-Server Coordination
Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
Data Sharing Options for Scientific Workflows on Amazon EC2
Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
Scalable repositories for virtual clusters
Euro-Par'09 Proceedings of the 2009 international conference on Parallel processing
EuroPar'10 Proceedings of the 16th international Euro-Par conference on Parallel processing: Part I
Automated tracing of I/O stack
EuroMPI'10 Proceedings of the 17th European MPI users' group meeting conference on Recent advances in the message passing interface
Benefits of high speed interconnects to cluster file systems: a case study with lustre
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
I/O conscious algorithm design and systems support for data analysis on emerging architectures
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Evaluating I/O characteristics and methods for storing structured scientific data
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
BlobSeer: Next-generation data management for large scale infrastructures
Journal of Parallel and Distributed Computing
Behavior-based problem localization for parallel file systems
HotDep'10 Proceedings of the Sixth international conference on Hot topics in system dependability
High performance multi-node file copies and checksums for clustered file systems
LISA'10 Proceedings of the 24th international conference on Large installation system administration
SnowFlock: Virtual Machine Cloning as a First-Class Cloud Primitive
ACM Transactions on Computer Systems (TOCS)
dBug: systematic evaluation of distributed systems
SSV'10 Proceedings of the 5th international conference on Systems software verification
Evaluating Parallel I/O Energy Efficiency
GREENCOM-CPSCOM '10 Proceedings of the 2010 IEEE/ACM Int'l Conference on Green Computing and Communications & Int'l Conference on Cyber, Physical and Social Computing
Tradeoffs in scalable data routing for deduplication clusters
FAST'11 Proceedings of the 9th USENIX conference on File and stroage technologies
FAST'11 Proceedings of the 9th USENIX conference on File and stroage technologies
PetaShare: A reliable, efficient and transparent distributed storage management system
Scientific Programming
SRC: Damaris - using dedicated i/o cores for scalable post-petascale HPC simulations
Proceedings of the international conference on Supercomputing
Making a case for distributed file systems at Exascale
Proceedings of the third international workshop on Large-scale system and application performance
Cumulus: an open source storage cloud for science
Proceedings of the 2nd international workshop on Scientific cloud computing
A cost-intelligent application-specific data layout scheme for parallel file systems
Proceedings of the 20th international symposium on High performance distributed computing
Going back and forth: efficient multideployment and multisnapshotting on clouds
Proceedings of the 20th international symposium on High performance distributed computing
Optimizing multi-deployment on clouds by means of self-adaptive prefetching
Euro-Par'11 Proceedings of the 17th international conference on Parallel processing - Volume Part I
Portable and scalable MPI shared file pointers
EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface
State of the Practice Reports
Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
Hadoop acceleration through network levitated merge
Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
A profiling approach for the management of writing in irregular applications
ISPA'06 Proceedings of the 2006 international conference on Frontiers of High Performance Computing and Networking
Using the Gfarm File System as a POSIX Compatible Storage Platform for Hadoop MapReduce Applications
GRID '11 Proceedings of the 2011 IEEE/ACM 12th International Conference on Grid Computing
PMPS(3): a performance model of parallel systems
ACSAC'06 Proceedings of the 11th Asia-Pacific conference on Advances in Computer Systems Architecture
Striping cache: a global cache for striped network file system
ACSAC'06 Proceedings of the 11th Asia-Pacific conference on Advances in Computer Systems Architecture
Automatic memory optimizations for improving MPI derived datatype performance
EuroPVM/MPI'06 Proceedings of the 13th European PVM/MPI User's Group conference on Recent advances in parallel virtual machine and message passing interface
Can MPI be used for persistent parallel services?
EuroPVM/MPI'06 Proceedings of the 13th European PVM/MPI User's Group conference on Recent advances in parallel virtual machine and message passing interface
Design and implementation of the home-based cooperative cache for PVFS
ICCS'05 Proceedings of the 5th international conference on Computational Science - Volume Part III
A high availability mechanism for parallel file system
APPT'05 Proceedings of the 6th international conference on Advanced Parallel Processing Technologies
One optimized I/O configuration per HPC application: leveraging the configurability of cloud
Proceedings of the Second Asia-Pacific Workshop on Systems
Implementing byte-range locks using MPI one-sided communication
PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Symmetrical data sieving for noncontiguous i/o accesses in molecular dynamics simulations
PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
CSAR-2: a case study of parallel file system dependability analysis
HPCC'05 Proceedings of the First international conference on High Performance Computing and Communications
Optimization of nonblocking MPI-I/O to a remote parallel virtual file system using a circular buffer
HPCC'05 Proceedings of the First international conference on High Performance Computing and Communications
The subgroup method for collective i/o
PDCAT'04 Proceedings of the 5th international conference on Parallel and Distributed Computing: applications and Technologies
Workflow overhead analysis and optimizations
Proceedings of the 6th workshop on Workflows in support of large-scale science
AME: an anyscale many-task computing engine
Proceedings of the 6th workshop on Workflows in support of large-scale science
Scientific data services: a high-performance I/O system with array semantics
Proceedings of the first annual workshop on High performance computing meets databases
A new i/o architecture for improving the performance in large scale clusters
ICCSA'06 Proceedings of the 2006 international conference on Computational Science and Its Applications - Volume Part V
Towards scalable I/O architecture for exascale systems
Proceedings of the 2011 ACM international workshop on Many task computing on grids and supercomputers
Euro-Par'06 Proceedings of the 12th international conference on Parallel Processing
Semi-sparse algorithm based on multi-layer optimization for recommendation system
Proceedings of the 2012 International Workshop on Programming Models and Applications for Multicores and Manycores
Towards scalable array-oriented active storage: the pyramid approach
ACM SIGOPS Operating Systems Review
A flexible two-level i/o architecture for grids
SAG'04 Proceedings of the First international conference on Scientific Applications of Grid Computing
A locking protocol for a distributed computing environment
EGC'05 Proceedings of the 2005 European conference on Advances in Grid Computing
Modularized redundant parallel virtual file system
ACSAC'05 Proceedings of the 10th Asia-Pacific conference on Advances in Computer Systems Architecture
Synchronization scheme using application-sensitive hint
AIC'10/BEBI'10 Proceedings of the 10th WSEAS international conference on applied informatics and communications, and 3rd WSEAS international conference on Biomedical electronics and biomedical informatics
An optimal candidate selection model for self-acting load balancing of parallel file system
International Journal of High Performance Computing and Networking
Bridging HPC and grid file i/o with IOFSL
PARA'10 Proceedings of the 10th international conference on Applied Parallel and Scientific Computing - Volume 2
Parallel file system measurement and modeling using colored petri nets
ICPE '12 Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering
An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2
Journal of Grid Computing
RXIO: Design and implementation of high performance RDMA-capable GridFTP
Computers and Electrical Engineering
A hybrid local storage transfer scheme for live migration of I/O intensive workloads
Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing
Fine-Grained Access Control in the Chirp Distributed File System
CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Boosting Application-Specific Parallel I/O Optimization Using IOSIG
CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
SERA-IO: Integrating Energy Consciousness into Parallel I/O Middleware
CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
TomusBlobs: Towards Communication-Efficient Storage for MapReduce Applications in Azure
CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
File system virtual appliances: Portable file system implementations
ACM Transactions on Storage (TOS)
A dynamic and adaptive load balancing strategy for parallel file system with large-scale I/O servers
Journal of Parallel and Distributed Computing
Modeling a leadership-scale storage system
PPAM'11 Proceedings of the 9th international conference on Parallel Processing and Applied Mathematics - Volume Part I
Parallel volume rendering on the IBM Blue Gene/P
EG PGV'08 Proceedings of the 8th Eurographics conference on Parallel Graphics and Visualization
A study on data deduplication in HPC storage systems
SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Compiler-directed file layout optimization for hierarchical storage systems
SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Optimizing distributed data access in grid environments by using artificial intelligence techniques
ISPA'07 Proceedings of the 5th international conference on Parallel and Distributed Processing and Applications
Transparent log-based data storage in MPI-IO applications
PVM/MPI'07 Proceedings of the 14th European conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
A windows-based parallel file system
HPCC'07 Proceedings of the Third international conference on High Performance Computing and Communications
Scalable Reed-Solomon-based reliable local storage for HPC applications on iaas clouds
Euro-Par'12 Proceedings of the 18th international conference on Parallel Processing
A New File-Specific Stripe Size Selection Method for Highly Concurrent Data Access
GRID '12 Proceedings of the 2012 ACM/IEEE 13th International Conference on Grid Computing
Two-level Hash/Table approach for metadata management in distributed file systems
The Journal of Supercomputing
Proceedings of the 22nd international symposium on High-performance parallel and distributed computing
AI-Ckpt: leveraging memory access patterns for adaptive asynchronous incremental checkpointing
Proceedings of the 22nd international symposium on High-performance parallel and distributed computing
A classification of file placement and replication methods on grids
Future Generation Computer Systems
Memory-conscious collective I/O for extreme scale HPC systems
Proceedings of the 3rd International Workshop on Runtime and Operating Systems for Supercomputers
ACIC: automatic cloud I/O configurator for HPC applications
SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Parallelizing the execution of sequential scripts
SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Insights for exascale IO APIs from building a petascale IO API
SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Leveraging collaborative content exchange for on-demand VM multi-deployments in iaas clouds
Euro-Par'13 Proceedings of the 19th international conference on Parallel Processing
Design of an active storage cluster file system for DAG workflows
DISCS-2013 Proceedings of the 2013 International Workshop on Data-Intensive Scalable Computing Systems
Network-aware data caching and prefetching for cloud-hosted metadata retrieval
NDM '13 Proceedings of the Third International Workshop on Network-Aware Data Management
Trevi: watering down storage hotspots with cool fountain codes
Proceedings of the Twelfth ACM Workshop on Hot Topics in Networks
Asynchronous object storage with QoS for scientific and commercial big data
PDSW '13 Proceedings of the 8th Parallel Data Storage Workshop
IKAROS: An HTTP-Based Distributed File System, for Low Consumption & Low Specification Devices
Journal of Grid Computing
Analysis of I/O Performance on an Amazon EC2 Cluster Compute and High I/O Platform
Journal of Grid Computing
Semi-sparse algorithm based on multi-layer optimization for recommender system
The Journal of Supercomputing
Compiler-directed file layout optimization for hierarchical storage systems
Scientific Programming - Selected Papers from Super Computing 2012
Horus: fine-grained encryption-based security for large-scale storage
FAST'13 Proceedings of the 11th USENIX conference on File and Storage Technologies
Optimizing I/O forwarding techniques for extreme-scale event tracing
Cluster Computing
GPFS-SNC: an enterprise cluster file system for big data
IBM Journal of Research and Development
Hi-index | 0.01 |
As Linux clusters have matured as platforms for low-cost, high-performance parallel computing, software packages to provide many key services have emerged, especially in areas such as message passing and networking. One area devoid of support, however, has been parallel file systems, which are critical for high-performance I/O on such clusters. We have developed a parallel file system for Linux clusters, called the Parallel Virtual File System (PVFS). PVFS is intended both as a high-performance parallel file system that anyone can download and use and as a tool for pursuing further research in parallel I/O and parallel file systems for Linux clusters. In this paper, we describe the design and implementation of PVFS and present performance results on the Chiba City cluster at Argonne. We provide performance results for a workload of concurrent reads and writes for various numbers of compute nodes, I/O nodes, and I/O request sizes. We also present performance results for MPI-IO on PVFS, both for a concurrent read/write workload and for the BTIO benchmark. We compare the I/O performance when using a Myrinet network versus a fast-ethernet network for I/O-related communication in PVFS. We obtained read and write bandwidths as high as 700 Mbytes/sec with Myrinet and 225 Mbytes/sec with fast ethernet.