An analytic behavior model for disk drives with readahead caches and request reordering
SIGMETRICS '98/PERFORMANCE '98 Proceedings of the 1998 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
Minerva: An automated resource provisioning tool for large-scale storage systems
ACM Transactions on Computer Systems (TOCS)
Analytic Modeling of Clustered RAID with Mapping Based on Nearly Random Permutation
IEEE Transactions on Computers
Hippodrome: Running Circles Around Storage Administration
FAST '02 Proceedings of the Conference on File and Storage Technologies
A Modular, Analytical Throughput Model for Modern Disk Arrays
MASCOTS '01 Proceedings of the Ninth International Symposium in Modeling, Analysis and Simulation of Computer and Telecommunication Systems
Issues and Challenges in the Performance Analysis of Real Disk Arrays
IEEE Transactions on Parallel and Distributed Systems
Storage Device Performance Prediction with CART Models
MASCOTS '04 Proceedings of the The IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems
Modeling the relative fitness of storage
Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
An Efficient Disk I/O Characteristics Collection Method Based on Virtual Machine Technology
HPCC '08 Proceedings of the 2008 10th IEEE International Conference on High Performance Computing and Communications
Easy and Efficient Disk I/O Workload Characterization in VMware ESX Server
IISWC '07 Proceedings of the 2007 IEEE 10th International Symposium on Workload Characterization
PARDA: proportional allocation of resources for distributed storage access
FAST '09 Proccedings of the 7th conference on File and storage technologies
The impact of management operations on the virtualized datacenter
Proceedings of the 37th annual international symposium on Computer architecture
vIC: interrupt coalescing for virtual machine storage device IO
USENIXATC'11 Proceedings of the 2011 USENIX conference on USENIX annual technical conference
Italian for beginners: the next steps for SLO-based management
HotStorage'11 Proceedings of the 3rd USENIX conference on Hot topics in storage and file systems
HotStorage'11 Proceedings of the 3rd USENIX conference on Hot topics in storage and file systems
Pesto: online storage performance management in virtualized datacenters
Proceedings of the 2nd ACM Symposium on Cloud Computing
A load-aware data placement policy on cluster file system
NPC'11 Proceedings of the 8th IFIP international conference on Network and parallel computing
Profit-driven scheduling for cloud services with data access awareness
Journal of Parallel and Distributed Computing
Scalable load balancing in cluster storage systems
Middleware'11 Proceedings of the 12th ACM/IFIP/USENIX international conference on Middleware
Sweet storage SLOs with Frosting
HotCloud'12 Proceedings of the 4th USENIX conference on Hot Topics in Cloud Ccomputing
Cake: enabling high-level SLOs on shared storage systems
Proceedings of the Third ACM Symposium on Cloud Computing
Romano: autonomous storage management using performance prediction in multi-tenant datacenters
Proceedings of the Third ACM Symposium on Cloud Computing
Scalable load balancing in cluster storage systems
Proceedings of the 12th International Middleware Conference
Model building for dynamic multi-tenant provider environments
ACM SIGOPS Operating Systems Review
Responding rapidly to service level violations using virtual appliances
ACM SIGOPS Operating Systems Review
Ursa: Scalable Load and Power Management in Cloud Storage Systems
ACM Transactions on Storage (TOS)
ORTHRUS: a lightweighted block-level cloud storage system
Cluster Computing
Balancing fairness and efficiency in tiered storage systems with bottleneck-aware allocation
FAST'14 Proceedings of the 12th USENIX conference on File and Storage Technologies
| Hi-index | 0.00 |
Live migration of virtual hard disks between storage arrays has long been possible. However, there is a dearth of online tools to perform automated virtual disk placement and IO load balancing across multiple storage arrays. This problem is quite challenging because the performance of IO workloads depends heavily on their own characteristics and that of the underlying storage device. Moreover, many device-specific details are hidden behind the interface exposed by storage arrays. In this paper, we introduce BASIL, a novel software system that automatically manages virtual disk placement and performs load balancing across devices without assuming any support from the storage arrays. BASIL uses IO latency as a primary metric for modeling. Our technique involves separate online modeling of workloads and storage devices. BASIL uses these models to recommend migrations between devices to balance load and improve overall performance. We present the design and implementation of BASIL in the context of VMware ESX, a hypervisor-based virtualization system, and demonstrate that the modeling works well for a wide range of workloads and devices. We evaluate the placements recommended by BASIL, and show that they lead to improvements of at least 25% in both latency and throughput for 80 percent of the hundreds of microbenchmark configurations we ran. When tested with enterprise applications, BASIL performed favorably versus human experts, improving latency by 18-27%.