A grid middleware for data management exploiting peer-to-peer techniques

Authors:
Athanasia Asiki;Katerina Doka;Ioannis Konstantinou;Antonis Zissimos;Dimitrios Tsoumakos;Nectarios Koziris;Panayiotis Tsanakas
Affiliations:
Computing Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Zografou Campus, Zografou 15773, Greece;Computing Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Zografou Campus, Zografou 15773, Greece;Computing Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Zografou Campus, Zografou 15773, Greece;Computing Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Zografou Campus, Zografou 15773, Greece;Computing Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Zografou Campus, Zografou 15773, Greece;Computing Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Zografou Campus, Zografou 15773, Greece;Computing Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Zografou Campus, Zografou 15773, Greece
Venue:
Future Generation Computer Systems
Year:
2009

Citing 24
Cited 5

A security architecture for computational grids

CCS '98 Proceedings of the 5th ACM conference on Computer and communications security
The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
Chord: A scalable peer-to-peer lookup service for internet applications

Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications
A scalable content-addressable network

Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications
Wide-area cooperative storage with CFS

SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
Data management and transfer in high-performance computational grid environments

Parallel Computing - Parallel data-intensive algorithms and applications
Analysis of the Clustering Properties of the Hilbert Space-Filling Curve

IEEE Transactions on Knowledge and Data Engineering
Skip graphs

SODA '03 Proceedings of the fourteenth annual ACM-SIAM symposium on Discrete algorithms
Kademlia: A Peer-to-Peer Information System Based on the XOR Metric

IPTPS '01 Revised Papers from the First International Workshop on Peer-to-Peer Systems
Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems

Middleware '01 Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms Heidelberg
Giggle: a framework for constructing scalable replica location services

Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Analysis of Multi-Dimensional Space-Filling Curves

Geoinformatica
Grid-Based Metadata Services

SSDBM '04 Proceedings of the 16th International Conference on Scientific and Statistical Database Management
Brief announcement: prefix hash tree

Proceedings of the twenty-third annual ACM symposium on Principles of distributed computing
One torus to rule them all: multi-dimensional queries in P2P systems

Proceedings of the 7th International Workshop on the Web and Databases: colocated with ACM SIGMOD/PODS 2004
Performance and Scalability of a Replica Location Service

HPDC '04 Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing
Enabling Flexible Queries with Guarantees in P2P Systems

IEEE Internet Computing
A Peer-to-Peer Replica Management Service for High-Throughput Grids

ICPP '05 Proceedings of the 2005 International Conference on Parallel Processing
A Scalable P2P Platform for the Knowledge Grid

IEEE Transactions on Knowledge and Data Engineering
Range Queries in Trie-Structured Overlays

P2P '05 Proceedings of the Fifth IEEE International Conference on Peer-to-Peer Computing
The Globus Striped GridFTP Framework and Server

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
CISS: An efficient object clustering framework for DHT-based peer-to-peer applications

Computer Networks: The International Journal of Computer and Telecommunications Networking
Alternative Algorithm for Hilbert's Space-Filling Curve

IEEE Transactions on Computers
Introduction to OGSA-DAI services

SAG'04 Proceedings of the First international conference on Scientific Applications of Grid Computing

Editorial: Special Section: Defining the grid, experiences and future trends

Future Generation Computer Systems
A study on performance of dynamic file replication algorithms for real-time file access in Data Grids

Future Generation Computer Systems
A P2P strategy for QoS discovery and SLA negotiation in Grid environment

Future Generation Computer Systems
eSciGrid: A P2P-based e-science Grid for scalable and efficient data sharing

Future Generation Computer Systems
Replica-aware, multi-dimensional range queries in Distributed Hash Tables

Computer Communications

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we describe a service-oriented middleware architecture for Grid environments which enables efficient data management. Our design introduces concepts from Peer-to-Peer computing in order to provide a scalable and reliable infrastructure for storage, search and retrieval of annotated content. To ensure fast file lookups in the distributed repositories, our system incorporates a multidimensional indexing scheme which serves the need for supporting both exact match and range queries over a group of metadata attributes. Finally, file transfers are conducted using GridTorrent, a grid-enabled, Peer-to-Peer mechanism that performs efficient data transfers by enabling cooperation among participating nodes and balances the cost of file transfer among them. The proposed architecture is the middleware component used by the GREDIA project, in which both media and banking partners plan to share large loads of annotated content.