Middleware-level collaborative resource discovery for large clusters

Authors:
Jameela Al-Jaroodi;Nader Mohamed
Affiliations:
Dependable Systems Middleware Research Laboratory, Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ;Dependable Systems Middleware Research Laboratory, Electrical and Computer Engineering, Stevens Institute of Technology, Hoboken, NJ
Venue:
CTS'05 Proceedings of the 2005 international conference on Collaborative technologies and systems
Year:
2005

Citing 7
Cited 0

On resource discovery in distributed systems with mobile hosts

MobiCom '96 Proceedings of the 2nd annual international conference on Mobile computing and networking
Software Agents for Future Communication Systems

Software Agents for Future Communication Systems
Matchmaking: Distributed Resource Management for High Throughput Computing

HPDC '98 Proceedings of the 7th IEEE International Symposium on High Performance Distributed Computing
Flexible Information Discovery in Decentralized Distributed Systems

HPDC '03 Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing
Asynchronous Resource Discovery in Peer to Peer Networks

SRDS '02 Proceedings of the 21st IEEE Symposium on Reliable Distributed Systems
NEVRLATE: Scalable Resource Discovery

CCGRID '02 Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid
Middleware infrastructure for parallel and distributed programming models in heterogeneous systems

IEEE Transactions on Parallel and Distributed Systems

Quantified Score

Hi-index	0.02

Visualization

Abstract

In this paper, we introduce a collaborative resource discovery mechanism to enhance system resource allocation and utilization by the distributed applications. The mechanism involves the collaboration of the software agents to collect, organize and efficiently exchange resources information. The main goal is to provide an accurate single system image for all the resources. The concept of virtual clusters is used to enhance localization of information and minimize exchanged messages. This mechanism is introduced as a part of the run-time support layer in Delmon. Delmon is a three-layer middleware framework for distributed systems, which includes the run-time support layer. This layer utilizes agents that reside on the participating machines and communicate with one another to perform the required functions. The agents hide the details of scheduling, controlling, monitoring, and executing user jobs, while the management of system resources is made transparent to the user. The proposed mechanism for collaborative resource discovery is based on the hierarchical structure of the agents and the organization and update protocols.