Minerva: An automated resource provisioning tool for large-scale storage systems
ACM Transactions on Computer Systems (TOCS)
Data Intensive Distributed Computing; A Medical Application Example
HPCN Europe '99 Proceedings of the 7th International Conference on High-Performance Computing and Networking
Communicating Quality of Service Requirements to an Object-Based Storage Device
MSST '05 Proceedings of the 22nd IEEE / 13th NASA Goddard Conference on Mass Storage Systems and Technologies
Applying grid technology to Web application systems
CCGRID '05 Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid - Volume 01
Grid Organizational Memory: A Versatile Solution for Ontology Management in the Grid
E-SCIENCE '06 Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
Future Generation Computer Systems
Out-of-core and compressed level set methods
ACM Transactions on Graphics (TOG)
WI '07 Proceedings of the IEEE/WIC/ACM International Conference on Web Intelligence
Restful web services
Translation of Common Information Model to Web Ontology Language
ICCS '07 Proceedings of the 7th international conference on Computational Science, Part I: ICCS 2007
Automated performance control in a virtual distributed storage system
GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
A parallel direct solver for the self-adaptive hp Finite Element Method
Journal of Parallel and Distributed Computing
Benefits of high speed interconnects to cluster file systems: a case study with lustre
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Effective Quality of Service Differentiation for Real-world Storage Systems
MASCOTS '10 Proceedings of the 2010 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems
Mahanaxar: Quality of service guarantees in high-bandwidth, real-time streaming data storage
MSST '10 Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST)
Algorithms for automatic data replication in grid environment
PPAM'05 Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics
PL-Grid: foundations and perspectives of national computing infrastructure
Building a National Distributed e-Infrastructure - PL-Grid
IEEE Transactions on Information Technology in Biomedicine
Polish computational research space for international scientific collaborations
PPAM'11 Proceedings of the 9th international conference on Parallel Processing and Applied Mathematics - Volume Part I
Hi-index | 0.00 |
In recent years, distributed environments such as grids and clouds have evolved quickly and become widely used for both business and scientific purposes. Grid environments are used for solving increasingly complex problems in order to provide more accurate and up-to-date results. However, evolution of modern grid middlewares does not follow current trends in their utilization, which often leads to problems concerning provisioning of resources in grid environments. Many users of grid systems stumble on performance issues during execution of their applications. A special kind of grid applications which are dependent on effective provisioning of storage resources constitute data-intensive grid applications, i.e. applications which operate on large datasets. This paper addresses the issue of effective provisioning of storage resources for data-intensive grid applications based on the best-effort strategy. In order to cater applications demand on storage resources in heterogeneous and dynamic grid environments, we propose an approach relying on a combination of a cluster file system technology, a dedicated storage resources monitoring service and a management layer. The paper describes the way that this combination of technologies solves the issue of effective storage resources provisioning in grid environments by presentation of the FiVO/QStorMan toolkit, which constitutes an implementation of the proposed approach. In order to prove that the proposed approach actually reduces data-intensive applications execution time, extensive evaluation of the framework is presented for motivating scenarios which overlap most kinds of data-intensive applications.