Automated proactive anomaly detection
Proceedings of the fifth IFIP/IEEE international symposium on Integrated network management V : integrated management in a virtual world: integrated management in a virtual world
Probabilistic Networks and Expert Systems
Probabilistic Networks and Expert Systems
The Vision of Autonomic Computing
Computer
ACM Transactions on Computer Systems (TOCS)
NetLogger: A Toolkit for Distributed System Performance Analysis
MASCOTS '00 Proceedings of the 8th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems
Adaptive stream resource management using Kalman Filters
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Probabilistic fault localization in communication systems using belief networks
IEEE/ACM Transactions on Networking (TON)
Towards autonomic web services: achieving self-healing using web services
DEAS '05 Proceedings of the 2005 workshop on Design and evolution of autonomic application software
Spatial correlation-based collaborative medium access control in wireless sensor networks
IEEE/ACM Transactions on Networking (TON)
Grid'5000: A Large Scale And Highly Reconfigurable Experimental Grid Testbed
International Journal of High Performance Computing Applications
Design and implementation tradeoffs for wide-area resource discovery
HPDC '05 Proceedings of the High Performance Distributed Computing, 2005. HPDC-14. Proceedings. 14th IEEE International Symposium
STAR: self-tuning aggregation for scalable monitoring
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Resource Bundles: Using Aggregation for Statistical Wide-Area Resource Discovery and Allocation
ICDCS '08 Proceedings of the 2008 The 28th International Conference on Distributed Computing Systems
Euro-Par '09 Proceedings of the 15th International Euro-Par Conference on Parallel Processing
GridICE: a monitoring service for Grid systems
Future Generation Computer Systems - Special issue: High-speed networks and services for data-intensive grids: The DataTAG project
A taxonomy of grid monitoring systems
Future Generation Computer Systems
Probabilistic temporal networks: A unified framework for reasoning with time and uncertainty
International Journal of Approximate Reasoning
CISIS '10 Proceedings of the 2010 International Conference on Complex, Intelligent and Software Intensive Systems
BlobSeer: Next-generation data management for large scale infrastructures
Journal of Parallel and Distributed Computing
Autonomic computing: an overview
UPP'04 Proceedings of the 2004 international conference on Unconventional Programming Paradigms
Towards a Generic Security Framework for Cloud Data Management Environments
International Journal of Distributed Systems and Technologies
Hi-index | 0.00 |
Introspection is the prerequisite of autonomic behavior, the first step towards performance improvement and resource usage optimization for large-scale distributed systems. In grid environments, the task of observing the application behavior is assigned to monitoring systems. However, most of them are designed to provide general resource information and do not consider specific information for higher-level services. More precisely, in the context of data-intensive applications, a specific introspection layer is required to collect data about the usage of storage resources, data access patterns, etc. This paper discusses the requirements for an introspection layer in a data management system for large-scale distributed infrastructures. We focus on the case of BlobSeer, a large-scale distributed system for storing massive data. The paper explains why and how to enhance BlobSeer with introspective capabilities and proposes a three-layered architecture relying on the MonALISA monitoring framework. We illustrate the autonomic behavior of BlobSeer with a self-configuration component aiming to provide storage elasticity by dynamically scaling the number of data providers. Then we propose a preliminary approach for enabling self-protection for the BlobSeer system, through a malicious client detection component. The introspective architecture has been evaluated on the Grid'5000 testbed, with experiments that prove the feasibility of generating relevant information related to the state and behavior of the system.