Scale and performance in a distributed file system
ACM Transactions on Computer Systems (TOCS)
A case for redundant arrays of inexpensive disks (RAID)
SIGMOD '88 Proceedings of the 1988 ACM SIGMOD international conference on Management of data
LogP: towards a realistic model of parallel computation
PPOPP '93 Proceedings of the fourth ACM SIGPLAN symposium on Principles and practice of parallel programming
A new approach to I/O performance evaluation: self-scaling I/O benchmarks, predicted I/O performance
SIGMETRICS '93 Proceedings of the 1993 ACM SIGMETRICS conference on Measurement and modeling of computer systems
Optimizing memory system performance for communication in parallel computers
ISCA '95 Proceedings of the 22nd annual international symposium on Computer architecture
Petal: distributed virtual disks
Proceedings of the seventh international conference on Architectural support for programming languages and operating systems
Parallel I/O for high performance computing
Parallel I/O for high performance computing
New TPC benchmarks for decision support and web commerce
ACM SIGMOD Record
OceanStore: an architecture for global-scale persistent storage
ASPLOS IX Proceedings of the ninth international conference on Architectural support for programming languages and operating systems
Scalability and resource usage of an OLAP benchmark on clusters of PCs
Proceedings of the fourteenth annual ACM symposium on Parallel algorithms and architectures
Using Sans and NAS
Farsite: federated, available, and reliable storage for an incompletely trusted environment
OSDI '02 Proceedings of the 5th symposium on Operating systems design and implementationCopyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading
Awarded Best Student Paper! - Pond: The OceanStore Prototype
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
lmbench: portable tools for performance analysis
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
Parallel OLAP with the Sidera server
Future Generation Computer Systems
Sidera: a cluster-based server for online analytical processing
OTM'07 Proceedings of the 2007 OTM confederated international conference on On the move to meaningful internet systems: CoopIS, DOA, ODBASE, GADA, and IS - Volume Part II
| Hi-index | 0.00 |
In this paper we attempt to parallelise a commodity database for OLAP on a cluster of commodity PCs by using a distributed high-performance storage subsystem. By parallelising the underlying storage architecture we eliminate the need to make any changes to the database software. We look at two options that differ in their complexity and features: Distributed devices and distributed file systems. The former aggregates several single disks within the cluster into a RAID device across the network. The latter offers all the features of a real file system at the price of a considerably increased complexity. We configured a Linux version of ORACLE to run on various distributed devices or distributed file systems, respectively, and ran a TPC-D benchmark on our cluster of commodity PCs interconnected by a Gigabit Ethernet. While distributed devices achieve at least the performance of local disks, they offer the benefit of using all surplus storage in a cluster. The distributed file systems seem to run into performance problems due to their increased complexity. We explain the experimental results with an analytic model of the cluster architecture and include a comparison of the same workload on an architecture that distributes the TPC-D queries at a higher level (and not just the underlying storage system). We conclude with suggestions for higher performances in future clusters of commodity PCs.