Processor-embedded distributed smart disks for I/O-intensive workloads: architectures, performance models and evaluation

Authors:
Steve C. Chiu;Wei-keng Liao;Alok N. Choudhary;Mahmut T. Kandemir
Affiliations:
Department of Electrical and Computer Engineering, Northwestern University, Evanston, IL 60208, USA;Department of Electrical and Computer Engineering, Northwestern University, Evanston, IL 60208, USA;Department of Electrical and Computer Engineering, Northwestern University, Evanston, IL 60208, USA;Department of Computer Science and Engineering, Pennsylvania State University, University Park, PA 16802, USA
Venue:
Journal of Parallel and Distributed Computing
Year:
2005

Citing 13
Cited 3

Parallel database systems: the future of high performance database systems

Communications of the ACM
A case for intelligent disks (IDISKs)

ACM SIGMOD Record
Active disks: programming model, algorithms and evaluation

Proceedings of the eighth international conference on Architectural support for programming languages and operating systems
Network attached storage architecture

Communications of the ACM
Survivable Information Storage Systems

Computer
A Case for Intelligent RAM

IEEE Micro
Parallel Mining of Association Rules

IEEE Transactions on Knowledge and Data Engineering
Scalable Parallel Data Mining for Association Rules

IEEE Transactions on Knowledge and Data Engineering
Improving Locality in Out-of-Core Computations Using Data Layout Transformations

LCR '98 Selected Papers from the 4th International Workshop on Languages, Compilers, and Run-Time Systems for Scalable Computers
Design and Evaluation of Smart Disk Architecture for DSS Commercial Workloads

ICPP '00 Proceedings of the Proceedings of the 2000 International Conference on Parallel Processing
Projecting the Performance of Decision Support Workloads on Systems

Projecting the Performance of Decision Support Workloads on Systems
Semantically-Smart Disk Systems

FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
An efficient parallel and distributed algorithm for counting frequent sets

VECPAR'02 Proceedings of the 5th international conference on High performance computing for computational science

PTask: operating system abstractions to manage GPUs as compute devices

SOSP '11 Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles
Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles

ACM SIGOPS 24th Symposium on Operating Systems Principles
Dandelion: a compiler and runtime for heterogeneous systems

Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles

Quantified Score

Hi-index	0.00

Visualization

Abstract

Processor-embedded disks, or smart disks, with their network interface controller, can in effect be viewed as processing elements with on-disk memory and secondary storage. The data sizes and access patterns of today's large I/O-intensive workloads require architectures whose processing power scales with increased storage capacity. To address this concern, we propose and evaluate disk-based distributed smart storage architectures. Based on analytically derived performance models, our evaluation with representative workloads show that offloading processing and performing point-to-point data communication improve performance over centralized architectures. Our results also demonstrate that distributed smart disk systems exhibit desirable scalability and can efficiently handle I/O-intensive workloads, such as commercial decision support database (TPC-H) queries, association rules mining, data clustering, and two-dimensional fast Fourier transform, among others.