A case study in building layered DHT applications
Proceedings of the 2005 conference on Applications, technologies, architectures, and protocols for computer communications
Lessons from resource allocators for large-scale multiuser testbeds
ACM SIGOPS Operating Systems Review
PlanetLab application management using plush
ACM SIGOPS Operating Systems Review
Grid information service based on network latency
InfoScale '06 Proceedings of the 1st international conference on Scalable information systems
Decentralised diffusion-based quota management
Proceedings of the 4th international workshop on Middleware for grid computing
Improving grid resource allocation via integrated selection and binding
Proceedings of the 2006 ACM/IEEE conference on Supercomputing
Using content-addressable networks for load balancing in desktop grids
Proceedings of the 16th international symposium on High performance distributed computing
Middleware 2007 Works in Progress
IEEE Distributed Systems Online
Remote control: distributed application configuration, management, and visualization with plush
LISA'07 Proceedings of the 21st conference on Large Installation System Administration Conference
Trade-offs in matching jobs and balancing load for distributed desktop grids
Future Generation Computer Systems
Squid: Enabling search in DHT-based systems
Journal of Parallel and Distributed Computing
netEmbed: a service for embedding distributed applications
Proceedings of the 2007 ACM/IFIP/USENIX international conference on Middleware companion
Resource discovery in federated systems with voluntary sharing
Proceedings of the 2007 ACM/IFIP/USENIX international conference on Middleware companion
Flexible resource allocation and composition across gsm/3g networks and wlans
Proceedings of the 3rd international workshop on Mobility in the evolving internet architecture
Towards a Self-structured Grid: An Ant-Inspired P2P Algorithm
Transactions on Computational Systems Biology X
Resource Discovery Techniques in Distributed Desktop Grid Environments
GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Synergy: sharing-aware component composition for distributed stream processing systems
Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware
Self-correlating predictive information tracking for large-scale production systems
ICAC '09 Proceedings of the 6th international conference on Autonomic computing
GRID Resource Searching on the GridSim Simulator
ICCS '09 Proceedings of the 9th International Conference on Computational Science: Part I
Reducing the bandwidth requirements of P2P keyword indexing
International Journal of High Performance Computing and Networking
A swarm algorithm for a self-structured P2P information system
IEEE Transactions on Evolutionary Computation
Using economic regulation to prevent resource congestion in large-scale shared infrastructures
Future Generation Computer Systems
Peloton: coordinated resource management for sensor networks
HotOS'09 Proceedings of the 12th conference on Hot topics in operating systems
Self-chord: a bio-inspired P2P framework for self-organizing distributed systems
IEEE/ACM Transactions on Networking (TON)
OLIC: online information compression for scalable hosting infrastructure monitoring
Proceedings of the Nineteenth International Workshop on Quality of Service
Modeling resource usage in planetary-scale shared infrastructures: PlanetLab's case study
Computer Networks: The International Journal of Computer and Telecommunications Networking
Distributed application configuration, management, and visualization with plush
ACM Transactions on Internet Technology (TOIT)
Bringing introspection into BlobSeer: Towards a self-adaptive distributed data management system
International Journal of Applied Mathematics and Computer Science - SPECIAL SECTION: Efficient Resource Management for Grid-Enabled Applications
Synergy: sharing-aware component composition for distributed stream processing systems
Middleware'06 Proceedings of the 7th ACM/IFIP/USENIX international conference on Middleware
A reconfiguration language for virtualized grid infrastructures
DAIS'10 Proceedings of the 10th IFIP WG 6.1 international conference on Distributed Applications and Interoperable Systems
A structured overlay for multi-dimensional range queries
Euro-Par'07 Proceedings of the 13th international Euro-Par conference on Parallel Processing
Autonomic load balancing mechanisms in the P2P desktop grid
Proceedings of the 2013 ACM Cloud and Autonomic Computing Conference
Decentralized resource discovery mechanisms for distributed computing in peer-to-peer environments
ACM Computing Surveys (CSUR)
Slice embedding solutions for distributed service architectures
ACM Computing Surveys (CSUR)
Exploiting multi-core nodes in peer-to-peer grids
Journal of Parallel and Distributed Computing
Hi-index | 0.00 |
This paper describes the design and implementation of SWORD, a scalable resource discovery service for wide-area distributed systems. In contrast to previous systems, SWORD allows users to describe desired resources as a topology of interconnected groups with required intragroup, intergroup, and per-node characteristics, along with the utility that the application derives from various ranges of values of those characteristics. This design gives users the flexibility to find geographically distributed resources for applications that are sensitive to both node and network characteristics, and allows the system to rank acceptable configurations based on their quality for that application. We explore a variety of architectures to deliver SWORD's functionality in a scalable and highly-available manner. A 1000-node ModelNet evaluation using a workload of measurements collected from PlanetLab shows that an architecture based on 4-node server cluster sites at network peering facilities outperforms a decentralized DHT-based resource discovery infrastructure for all but the smallest number of sites. While such a centralized architecture shows significant promise, we find that our decentralized implementation, both in emulation and running continuously on over 200 PlanetLab nodes, performs well while benefiting from the DHT's self-healing properties.