The design and implementation of a log-structured file system
SOSP '91 Proceedings of the thirteenth ACM symposium on Operating systems principles
Measurements of a distributed file system
SOSP '91 Proceedings of the thirteenth ACM symposium on Operating systems principles
Non-volatile memory for fast, reliable file systems
ASPLOS V Proceedings of the fifth international conference on Architectural support for programming languages and operating systems
Serverless network file systems
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
Managing energy and server resources in hosting centers
SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
Massive arrays of idle disks for storage archives
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Conserving disk energy in network servers
ICS '03 Proceedings of the 17th annual international conference on Supercomputing
DRPM: dynamic speed control for power management in server class disks
Proceedings of the 30th annual international symposium on Computer architecture
Energy conservation techniques for disk array-based servers
Proceedings of the 18th annual international conference on Supercomputing
Power-Aware Storage Cache Management
IEEE Transactions on Computers
Passive NFS Tracing of Email and Research Workloads
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
Modeling Hard-Disk Power Consumption
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
Hibernator: helping disk arrays sleep through the winter
Proceedings of the twentieth ACM symposium on Operating systems principles
Tracefs: A File System to Trace Them All
FAST '04 Proceedings of the 3rd USENIX Conference on File and Storage Technologies
EERAID: energy efficient redundant and inexpensive disk array
Proceedings of the 11th workshop on ACM SIGOPS European workshop
Interplay of energy and performance for disk arrays running transaction processing workloads
ISPASS '03 Proceedings of the 2003 IEEE International Symposium on Performance Analysis of Systems and Software
Proceedings of the 1st ACM SIGOPS/EuroSys European Conference on Computer Systems 2006
TBBT: scalable and accurate trace replay for file server evaluation
FAST'05 Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies - Volume 4
Accurate and efficient replaying of file system traces
FAST'05 Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies - Volume 4
Energy-efficiency and storage flexibility in the blue file system
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Thwarting the power-hungry disk
WTEC'94 Proceedings of the USENIX Winter 1994 Technical Conference on USENIX Winter 1994 Technical Conference
An implementation of a log-structured file system for UNIX
USENIX'93 Proceedings of the USENIX Winter 1993 Conference Proceedings on USENIX Winter 1993 Conference Proceedings
Cooperative caching: using remote client memory to improve file system performance
OSDI '94 Proceedings of the 1st USENIX conference on Operating Systems Design and Implementation
Disk failures in the real world: what does an MTTF of 1,000,000 hours mean to you?
FAST '07 Proceedings of the 5th USENIX conference on File and Storage Technologies
Failure trends in a large disk drive population
FAST '07 Proceedings of the 5th USENIX conference on File and Storage Technologies
PARAID: a gear-shifting power-aware RAID
FAST '07 Proceedings of the 5th USENIX conference on File and Storage Technologies
Optimizing power consumption in large scale storage systems
HOTOS'07 Proceedings of the 11th USENIX workshop on Hot topics in operating systems
Fine-grained energy profiling for power-aware application design
ACM SIGMETRICS Performance Evaluation Review
Migrating server storage to SSDs: analysis of tradeoffs
Proceedings of the 4th ACM European conference on Computer systems
WorkOut: I/O workload outsourcing for boosting RAID reconstruction performance
FAST '09 Proccedings of the 7th conference on File and storage technologies
Storage modeling for power estimation
SYSTOR '09 Proceedings of SYSTOR 2009: The Israeli Experimental Systems Conference
Energy and performance evaluation of lossless file data compression on server systems
SYSTOR '09 Proceedings of SYSTOR 2009: The Israeli Experimental Systems Conference
Energy Smart Management of Scientific Data
SSDBM 2009 Proceedings of the 21st International Conference on Scientific and Statistical Database Management
Feasibility regions: exploiting tradeoffs between power and performance in disk drives
ACM SIGMETRICS Performance Evaluation Review
Energy proportionality for storage: impact and feasibility
ACM SIGOPS Operating Systems Review
Robust and flexible power-proportional storage
Proceedings of the 1st ACM symposium on Cloud computing
Autonomic exploration of trade-offs between power and performance in disk drives
Proceedings of the 7th international conference on Autonomic computing
Optimizing energy and performance for server-class file system workloads
ACM Transactions on Storage (TOS)
Extending SSD lifetimes with disk-based write caches
FAST'10 Proceedings of the 8th USENIX conference on File and storage technologies
Evaluating performance and energy in file system server workloads
FAST'10 Proceedings of the 8th USENIX conference on File and storage technologies
SRCMap: energy proportional storage using dynamic consolidation
FAST'10 Proceedings of the 8th USENIX conference on File and storage technologies
A spin-up saved is energy earned: achieving power-efficient, erasure-coded storage
HotDep'08 Proceedings of the Fourth conference on Hot topics in system dependability
Everest: scaling down peak loads through I/O off-loading
OSDI'08 Proceedings of the 8th USENIX conference on Operating systems design and implementation
Dynamic data reorganization for energy savings in disk storage systems
SSDBM'10 Proceedings of the 22nd international conference on Scientific and statistical database management
Adaptive workload shaping for power savings on disk drives
Proceedings of the 2nd ACM/SPEC International Conference on Performance engineering
Cost effective storage using extent based dynamic tiering
FAST'11 Proceedings of the 9th USENIX conference on File and stroage technologies
Sierra: practical power-proportionality for data center storage
Proceedings of the sixth conference on Computer systems
Online availability upgrades for parity-based RAIDs through supplementary parity augmentations
ACM Transactions on Storage (TOS)
On the energy consumption and performance of systems software
Proceedings of the 4th Annual International Conference on Systems and Storage
LazyFTL: a page-level flash translation layer optimized for NAND flash memory
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
QMD: exploiting flash for energy efficient disk arrays
Proceedings of the Seventh International Workshop on Data Management on New Hardware
Reorder the write sequence by virtual write buffer to extend SSD's lifespan
NPC'11 Proceedings of the 8th IFIP international conference on Network and parallel computing
Copy rate synchronization with performance guarantees for work consolidation in storage clusters
ACM SIGMETRICS Performance Evaluation Review
Frugal storage for cloud file systems
Proceedings of the 7th ACM european conference on Computer Systems
FlashTier: a lightweight, consistent and durable storage cache
Proceedings of the 7th ACM european conference on Computer Systems
From the origins of performance evaluation to new green ICT performance engineering
PERFORM'10 Proceedings of the 2010 IFIP WG 6.3/7.3 international conference on Performance Evaluation of Computer and Communication Systems: milestones and future challenges
Power consumption in enterprise-scale backup storage systems
FAST'12 Proceedings of the 10th USENIX conference on File and Storage Technologies
Lifetime management of flash-based SSDs using recovery-aware dynamic throttling
FAST'12 Proceedings of the 10th USENIX conference on File and Storage Technologies
HotDataTrap: a sampling-based hot data identification scheme for flash memory
Proceedings of the 27th Annual ACM Symposium on Applied Computing
Gnothi: separating data and metadata for efficient and available storage replication
USENIX ATC'12 Proceedings of the 2012 USENIX conference on Annual Technical Conference
SAC: rethinking the cache replacement policy for SSD-based storage systems
Proceedings of the 5th Annual International Systems and Storage Conference
Analytic modeling of SSD write performance
Proceedings of the 5th Annual International Systems and Storage Conference
E-HASH: an energy-efficient hybrid storage system composed of one SSD and multiple HDDs
ICSI'12 Proceedings of the Third international conference on Advances in Swarm Intelligence - Volume Part II
Toward fast eventual consistency with performance guarantees
Proceedings of the 9th international conference on Autonomic computing
Quantitative estimation of the performance delay with propagation effects in disk power savings
HotPower'12 Proceedings of the 2012 USENIX conference on Power-Aware Computing and Systems
CacheRAID: An Efficient Adaptive Write Cache Policy to Conserve RAID Disk Array Energy
UCC '12 Proceedings of the 2012 IEEE/ACM Fifth International Conference on Utility and Cloud Computing
Responding rapidly to service level violations using virtual appliances
ACM SIGOPS Operating Systems Review
lisa'12 Proceedings of the 26th international conference on Large Installation System Administration: strategies, tools, and techniques
An on-line hot data identification for flash-based storage using sampling mechanism
ACM SIGAPP Applied Computing Review
On reducing energy management delays in disks
Journal of Parallel and Distributed Computing
High performance & low latency in solid-state drives through redundancy
Proceedings of the 1st Workshop on Interactions of NVM/FLASH with Operating Systems and Workloads
Improving NAND endurance by dynamic program and erase scaling
HotStorage'13 Proceedings of the 5th USENIX conference on Hot Topics in Storage and File Systems
Analytic Models of SSD Write Performance
ACM Transactions on Storage (TOS)
Write policies for host-side flash caches
FAST'13 Proceedings of the 11th USENIX conference on File and Storage Technologies
Warming up storage-level caches with bonfire
FAST'13 Proceedings of the 11th USENIX conference on File and Storage Technologies
MixApart: decoupled analytics for shared storage systems
FAST'13 Proceedings of the 11th USENIX conference on File and Storage Technologies
Wear unleveling: improving NAND flash lifetime by balancing page endurance
FAST'14 Proceedings of the 12th USENIX conference on File and Storage Technologies
Lifetime improvement of NAND flash-based storage systems using dynamic program and erase scaling
FAST'14 Proceedings of the 12th USENIX conference on File and Storage Technologies
SpringFS: bridging agility and performance in elastic distributed storage
FAST'14 Proceedings of the 12th USENIX conference on File and Storage Technologies
Hi-index | 0.00 |
In enterprise data centers power usage is a problem impacting server density and the total cost of ownership. Storage uses a significant fraction of the power budget and there are no widely deployed power-saving solutions for enterprise storage systems. The traditional view is that enterprise workloads make spinning disks down ineffective because idle periods are too short. We analyzed block-level traces from 36 volumes in an enterprise data center for one week and concluded that significant idle periods exist, and that they can be further increased by modifying the read/write patterns using write off-loading. Write off-loading allows write requests on spun-down disks to be temporarily redirected to persistent storage elsewhere in the data center. The key challenge is doing this transparently and efficiently at the block level, without sacrificing consistency or failure resilience. We describe our write offloading design and implementation that achieves these goals. We evaluate it by replaying portions of our traces on a rack-based testbed. Results show that just spinning disks down when idle saves 28-36% of energy, and write off-loading further increases the savings to 45-60%.