Distributed smart disks for I/O-intensive workloads on switched interconnects

Authors:
Steve C. Chiu;Wei-keng Liao;Alok N. Choudhary
Affiliations:
Department of Electrical and Computer Engineering, Northwestern University, Evanston, IL 60208, USA;Department of Electrical and Computer Engineering, Northwestern University, Evanston, IL 60208, USA;Department of Electrical and Computer Engineering, Northwestern University, Evanston, IL 60208, USA
Venue:
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
Year:
2006

Citing 13
Cited 0

Parallel database systems: the future of high performance database systems

Communications of the ACM
On the versatility of parallel sorting by regular sampling

Parallel Computing
Mining generalized association rules

Future Generation Computer Systems - Special double issue on data mining
A case for intelligent disks (IDISKs)

ACM SIGMOD Record
Active disks: programming model, algorithms and evaluation

Proceedings of the eighth international conference on Architectural support for programming languages and operating systems
Network attached storage architecture

Communications of the ACM
Transaction Processing: Concepts and Techniques

Transaction Processing: Concepts and Techniques
Parallel Mining of Association Rules

IEEE Transactions on Knowledge and Data Engineering
Scalable Parallel Data Mining for Association Rules

IEEE Transactions on Knowledge and Data Engineering
Design and Evaluation of Smart Disk Architecture for DSS Commercial Workloads

ICPP '00 Proceedings of the Proceedings of the 2000 International Conference on Parallel Processing
Projecting the Performance of Decision Support Workloads on Systems

Projecting the Performance of Decision Support Workloads on Systems
Storage Network Performance Analysis

Storage Network Performance Analysis
An efficient parallel and distributed algorithm for counting frequent sets

VECPAR'02 Proceedings of the 5th international conference on High performance computing for computational science

Quantified Score

Hi-index	0.00

Visualization

Abstract

Disk-based smart storage represents processor-embedded active I/O devices that are equipped with a dedicated network interface controller and on-disk storage (memory and disk). Today's I/O-intensive workloads require architectures whose performance scales with increasing storage capacity. The advent of switch-based, low-latency and high-bandwidth network protocols, such as Virtual Interface Architecture and InfiniBand, promises to improve both performance and scalability beyond current state-of-the-art I/O interconnect topologies. This paper evaluates a disk-based distributed smart storage architecture composed of fully distributed processor-embedded disks that are interconnected by a high-performance switched network, and investigates the performance of the proposed processing model on different storage interconnects with representative workloads, including TPC-H queries, association rules mining, high-dimensional data clustering, and two-dimensional fast Fourier transform (FFT).