A case for redundant arrays of inexpensive disks (RAID)
SIGMOD '88 Proceedings of the 1988 ACM SIGMOD international conference on Management of data
The placement optimization program: a practical solution to the disk file assignment problem
SIGMETRICS '89 Proceedings of the 1989 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
IBM Systems Journal
Competitive distributed file allocation
STOC '93 Proceedings of the twenty-fifth annual ACM symposium on Theory of computing
Kitrace: precise interactive measurement of operating systems kernels
Software—Practice & Experience
A genetic algorithm for the generalised assignment problem
Computers and Operations Research
Comparative Models of the File Assignment Problem
ACM Computing Surveys (CSUR)
Computers and Intractability: A Guide to the Theory of NP-Completeness
Computers and Intractability: A Guide to the Theory of NP-Completeness
Analytic Modeling of Clustered RAID with Mapping Based on Nearly Random Permutation
IEEE Transactions on Computers
Performance Analysis of RAID5 Disk Arrays with a Vacationing Server Model for Rebuild Mode Operation
Proceedings of the Tenth International Conference on Data Engineering
A Policy-Based Storage Management Framework
POLICY '02 Proceedings of the 3rd International Workshop on Policies for Distributed Systems and Networks (POLICY'02)
Issues and Challenges in the Performance Analysis of Real Disk Arrays
IEEE Transactions on Parallel and Distributed Systems
Multi-dimensional storage virtualization
Proceedings of the joint international conference on Measurement and modeling of computer systems
Hippodrome: Running Circles Around Storage Administration
FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
Selecting RAID Levels for Disk Arrays
FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
Appia: Automatic Storage Area Network Fabric Design
FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
Aqueduct: Online Data Migration with Performance Guarantees
FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
Façade: Virtual Storage Devices with Performance Guarantees
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
Polus: Growing Storage QoS Management Beyond a "4-Year Old Kid"
FAST '04 Proceedings of the 3rd USENIX Conference on File and Storage Technologies
FAST '04 Proceedings of the 3rd USENIX Conference on File and Storage Technologies
Scalable and fault-tolerant support for variable bit-rate data in the exedra streaming server
ACM Transactions on Storage (TOS)
Quickly finding near-optimal storage designs
ACM Transactions on Computer Systems (TOCS)
EW 10 Proceedings of the 10th workshop on ACM SIGOPS European workshop
Challenges in managing dependable data systems
ACM SIGMETRICS Performance Evaluation Review - Design, implementation, and performance of storage systems
Relative fitness models for storage
ACM SIGMETRICS Performance Evaluation Review - Design, implementation, and performance of storage systems
Exploiting redundancy to conserve energy in storage systems
SIGMETRICS '06/Performance '06 Proceedings of the joint international conference on Measurement and modeling of computer systems
Scheduling with QoS in parallel I/O systems
SNAPI '04 Proceedings of the international workshop on Storage network architecture and parallel I/Os
Component-based performance modeling of a storage area network
WSC '05 Proceedings of the 37th conference on Winter simulation
Storage performance virtualization via throughput and latency control
ACM Transactions on Storage (TOS)
CHAMELEON: a self-evolving, fully-adaptive resource arbitrator for storage systems
ATEC '05 Proceedings of the annual conference on USENIX Annual Technical Conference
HOTDEP'06 Proceedings of the 2nd conference on Hot Topics in System Dependability - Volume 2
Zodiac: efficient impact analysis for storage area networks
FAST'05 Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies - Volume 4
Performance modeling and system management for multi-component online services
NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Virtual I/O scheduler: a scheduler of schedulers for performance virtualization
Proceedings of the 3rd international conference on Virtual execution environments
Modeling the relative fitness of storage
Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Storage optimization for large-scale distributed stream-processing systems
ACM Transactions on Storage (TOS)
Policy-driven management of data sets
LISA'07 Proceedings of the 21st conference on Large Installation System Administration Conference
Don't settle for less than the best: use optimization to make decisions
HOTOS'07 Proceedings of the 11th USENIX workshop on Hot topics in operating systems
Using utility to provision storage systems
FAST'08 Proceedings of the 6th USENIX Conference on File and Storage Technologies
The case for active block layer extensions
ACM SIGOPS Operating Systems Review
Evolution of storage management: transforming raw data into information
IBM Journal of Research and Development
Automated planners for storage provisioning and disaster recovery
IBM Journal of Research and Development
Traveling to Rome: a retrospective on the journey
ACM SIGOPS Operating Systems Review
DHIS: discriminating hierarchical storage
SYSTOR '09 Proceedings of SYSTOR 2009: The Israeli Experimental Systems Conference
Applying genetic algorithms to decision making in autonomic computing systems
ICAC '09 Proceedings of the 6th international conference on Autonomic computing
Automated performance control in a virtual distributed storage system
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
Higher reliability redundant disk arrays: Organization, operation, and coding
ACM Transactions on Storage (TOS)
A file assignment strategy independent of workload characteristic assumptions
ACM Transactions on Storage (TOS)
Secure and efficient access to outsourced data
Proceedings of the 2009 ACM workshop on Cloud computing security
Modeling workloads and devices for IO load balancing in virtualized environments
ACM SIGMETRICS Performance Evaluation Review
A practical learning-based approach for dynamic storage bandwidth allocation
IWQoS'03 Proceedings of the 11th international conference on Quality of service
A component-based analytical performance model of IP-based SAN
GPC'08 Proceedings of the 3rd international conference on Advances in grid and pervasive computing
A load balancing framework for clustered storage systems
HiPC'08 Proceedings of the 15th international conference on High performance computing
Workload-aware storage layout for database systems
Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
BASIL: automated IO load balancing across storage devices
FAST'10 Proceedings of the 8th USENIX conference on File and storage technologies
SnowFlock: Virtual Machine Cloning as a First-Class Cloud Primitive
ACM Transactions on Computer Systems (TOCS)
Cost effective storage using extent based dynamic tiering
FAST'11 Proceedings of the 9th USENIX conference on File and stroage technologies
Hippodrome: running circles around storage administration
FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
Selecting RAID levels for disk arrays
FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
Appia: automatic storage area network fabric design
FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
Aqueduct: online data migration with performance guarantees
FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
Façade: virtual storage devices with performance guarantees
FAST'03 Proceedings of the 2nd USENIX conference on File and storage technologies
Polus: growing storage QoS management beyond a "four-year old kid"
FAST'04 Proceedings of the 3rd USENIX conference on File and storage technologies
FAST'04 Proceedings of the 3rd USENIX conference on File and storage technologies
Walking toward moving goalposts: agile management for evolving systems
HotACI'06 Proceedings of the First international conference on Hot topics in autonomic computing
HotDep'06 Proceedings of the Second conference on Hot topics in system dependability
RAID level selection for heterogeneous disk arrays
Cluster Computing
Italian for beginners: the next steps for SLO-based management
HotStorage'11 Proceedings of the 3rd USENIX conference on Hot topics in storage and file systems
Pesto: online storage performance management in virtualized datacenters
Proceedings of the 2nd ACM Symposium on Cloud Computing
A systematic scheme to resolve qos dissatisfaction for storage cluster
NPC'05 Proceedings of the 2005 IFIP international conference on Network and Parallel Computing
An overview on automatic capacity planning
From Integrated Publication and Information Systems to Virtual Information and Knowledge Environments
Trading off security in a service oriented architecture
DBSec'05 Proceedings of the 19th annual IFIP WG 11.3 working conference on Data and Applications Security
Autonomic storage system based on automatic learning
HiPC'04 Proceedings of the 11th international conference on High Performance Computing
The role of agreements in IT management software
Architecting Dependable Systems III
scc: cluster storage provisioning informed by application characteristics and SLAs
FAST'12 Proceedings of the 10th USENIX conference on File and Storage Technologies
Planning for optimal multi-site data distribution for disaster recovery
GECON'11 Proceedings of the 8th international conference on Economics of Grids, Clouds, Systems, and Services
A Workflow-Aware Storage System: An Opportunity Study
CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
QoS-based storage resources provisioning for grid applications
Future Generation Computer Systems
Responding rapidly to service level violations using virtual appliances
ACM SIGOPS Operating Systems Review
Proportional Allocation of Resources on Shared Ring Buffer for Virtualization
International Journal of Cloud Applications and Computing
ACIC: automatic cloud I/O configurator for HPC applications
SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Taming parallel I/O complexity with auto-tuning
SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles
ACM SIGOPS 24th Symposium on Operating Systems Principles
SPANStore: cost-effective geo-replicated storage spanning multiple cloud services
Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles
Janus: optimal flash provisioning for cloud storage workloads
USENIX ATC'13 Proceedings of the 2013 USENIX conference on Annual Technical Conference
Hi-index | 0.00 |
Enterprise-scale storage systems, which can contain hundreds of host computers and storage devices and up to tens of thousands of disks and logical volumes, are difficult to design. The volume of choices that need to be made is massive, and many choices have unforeseen interactions. Storage system design is tedious and complicated to do by hand, usually leading to solutions that are grossly over-provisioned, substantially under-performing or, in the worst case, both.To solve the configuration nightmare, we present minerva: a suite of tools for designing storage systems automatically. Minerva uses declarative specifications of application requirements and device capabilities; constraint-based formulations of the various sub-problems; and optimization techniques to explore the search space of possible solutions.This paper also explores and evaluates the design decisions that went into Minerva, using specialized micro- and macro-benchmarks. We show that Minerva can successfully handle a workload with substantial complexity (a decision-support database benchmark). Minerva created a 16-disk design in only a few minutes that achieved the same performance as a 30-disk system manually designed by human experts. Of equal importance, Minerva was able to predict the resulting system's performance before it was built.