File-Access Characteristics of Parallel Scientific Workloads
IEEE Transactions on Parallel and Distributed Systems
On implementing MPI-IO portably and with high performance
Proceedings of the sixth workshop on I/O in parallel and distributed systems
File-System Workload on a Scientific Multiprocessor
IEEE Parallel & Distributed Technology: Systems & Technology
Conserving disk energy in network servers
ICS '03 Proceedings of the 17th annual international conference on Supercomputing
DRPM: dynamic speed control for power management in server class disks
Proceedings of the 30th annual international symposium on Computer architecture
Power and Energy Profiling of Scientific Applications on Distributed Systems
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
Improvement of Power-Performance Efficiency for High-End Computing
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 11 - Volume 12
Hibernator: helping disk arrays sleep through the winter
Proceedings of the twentieth ACM symposium on Operating systems principles
Just In Time Dynamic Voltage Scaling: Exploiting Inter-Node Slack to Save Energy in MPI Programs
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Proceedings of the 2006 ACM/IEEE conference on Supercomputing
Software-directed power-aware interconnection networks
ACM Transactions on Architecture and Code Optimization (TACO)
PVFS: a parallel file system for linux clusters
ALS'00 Proceedings of the 4th annual Linux Showcase & Conference - Volume 4
Directory-Based Metadata Optimizations for Small Files in PVFS
Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
Energy-Aware Prefetching for Parallel Disk Systems: Algorithms, Models, and Evaluation
NCA '09 Proceedings of the 2009 Eighth IEEE International Symposium on Network Computing and Applications
HYBUD: An Energy-Efficient Architecture for Hybrid Parallel Disk Systems
ICCCN '09 Proceedings of the 2009 Proceedings of 18th International Conference on Computer Communications and Networks
Performance Evaluation of Energy-Efficient Parallel I/O Systems with Write Buffer Disks
ICPP '09 Proceedings of the 2009 International Conference on Parallel Processing
PowerPack: Energy Profiling and Analysis of High-Performance Systems and Applications
IEEE Transactions on Parallel and Distributed Systems
The synergy between power-aware memory systems and processor voltage scaling
PACS'03 Proceedings of the Third international conference on Power - Aware Computer Systems
SERA-IO: Integrating Energy Consciousness into Parallel I/O Middleware
CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Hi-index | 0.00 |
Energy efficiency and parallel I/O performance are two primary constraints in high performance computing (HPC). Large scale computing systems consume vast amounts of energy and require scalable I/O performance to meet the needs of a broad spectrum of data intensive scientific applications. However, little research has provided an in-depth understanding of energy efficiency in parallel I/O subsystems. In this paper, we experimentally investigate the efficiency impact of a wide range of variables including the application's access patterns, parallel file system deployment, and processor frequency scaling. Our studies lead to several key findings on parallel I/O energy efficiency. First, the application's I/O access pattern significantly affects system energy efficiency. By aggregating file accesses and choosing appropriate data sizes, we can both improve performance and reduce energy use. Second, parallel file systems, such as PVFS, not only increase the I/O scalability but also are more energy efficient. Matching the application's I/O buffer size to the file system strip size will lead to much higher efficiency than poorly chosen I/O buffer sizes. Third, DVFS can further reduce energy use of parallel I/O operations with little performance impact. These findings are useful to guide the development of energy efficient HPC systems and software.