The MOSIX Direct File System Access Method for Supporting Scalable Cluster File Systems

Authors:
Lior Amar;Amnon Barak;Amnon Shiloh
Affiliations:
Institute of Computer Science, The Hebrew University of Jerusalem, Jerusalem, 91904 Israel;Institute of Computer Science, The Hebrew University of Jerusalem, Jerusalem, 91904 Israel;Institute of Computer Science, The Hebrew University of Jerusalem, Jerusalem, 91904 Israel
Venue:
Cluster Computing
Year:
2004

Citing 10
Cited 0

PVM: Parallel virtual machine: a users' guide and tutorial for networked parallel computing

PVM: Parallel virtual machine: a users' guide and tutorial for networked parallel computing
Serverless network file systems

ACM Transactions on Computer Systems (TOCS) - Special issue on operating system principles
Parallel programming with MPI

Parallel programming with MPI
Exploiting process lifetime distributions for dynamic load balancing

ACM Transactions on Computer Systems (TOCS)
Exploiting local data in parallel array I/O on a practical network of workstations

Proceedings of the fifth workshop on I/O in parallel and distributed systems
The MOSIX multicomputer operating system for high performance cluster computing

Future Generation Computer Systems - Special issue on HPCN '97
Processing large-scale multi-dimensional data in parallel and distributed environments

Parallel Computing - Parallel data-intensive algorithms and applications
Opportunity Cost Algorithms for Reduction of I/O and Interprocess Communication Overhead in a Computing Cluster

IEEE Transactions on Parallel and Distributed Systems
GPFS: A Shared-Disk File System for Large Computing Clusters

FAST '02 Proceedings of the Conference on File and Storage Technologies
Dynamic function placement for data-intensive cluster computing

ATEC '00 Proceedings of the annual conference on USENIX Annual Technical Conference

Quantified Score

Hi-index	0.00

Visualization

Abstract

MOSIX is a cluster management system that supports preemptive process migration. This paper presents the MOSIX Direct File System Access (DFSA), a provision that can improve the performance of cluster file systems by allowing a migrated process to directly access files in its current location. This capability, when combined with an appropriate file system, could substantially increase the I/O performance and reduce the network congestion by migrating an I/O intensive process to a file server rather than the traditional way of bringing the file's data to the process. DFSA is suitable for clusters that manage a pool of shared disks among multiple machines. With DFSA, it is possible to migrate parallel processes from a client node to file servers for parallel access to different files. Any consistent file system can be adjusted to work with DFSA. To test its performance, we developed the MOSIX File-System (MFS) which allows consistent parallel operations on different files. The paper describes DFSA and presents the performance of MFS with and without DFSA.