Active Proxy-G: optimizing the query execution process in the grid

Authors:
Henrique Andrade;Tahsin Kurc;Alan Sussman;Joel Saltz
Affiliations:
University of Maryland, College Park, MD;The Ohio State University, Columbus, OH;University of Maryland, College Park, MD;University of Maryland, College Park, MD and The Ohio State University, Columbus, OH
Venue:
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Year:
2002

Citing 23
Cited 6

Rapid octree construction from image sequences

CVGIP: Image Understanding
A security architecture for computational grids

CCS '98 Proceedings of the 5th ACM conference on Computer and communications security
Cluster I/O with River: making the fast case common

Proceedings of the sixth workshop on I/O in parallel and distributed systems
Performance impact of proxies in data intensive client-server applications

ICS '99 Proceedings of the 13th international conference on Supercomputing
Running EveryWare on the computational grid

SC '99 Proceedings of the 1999 ACM/IEEE conference on Supercomputing
The network weather service: a distributed resource performance forecasting service for metacomputing

Future Generation Computer Systems - Special issue on metacomputing
MOCHA: a self-extensible database middleware system for distributed data sources

SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
Using high-speed WANs and network data caches to enable remote and distributed visualization

Proceedings of the 2000 ACM/IEEE conference on Supercomputing
High-performance remote access to climate simulation data: a challenge problem for data grid technologies

Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Efficient execution of multiple query workloads in data analysis applications

Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Improving Proxy Cache Performance: Analysis of Three Replacement Policies

IEEE Internet Computing
Scheduling Multiple Data Visualization Query Workloads on a Shared Memory Machine

IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Toward a Framework for Preparing and Executing Adaptive Grid Programs

IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Performance Optimization for Data Intensive Grid Applications

AMS '01 Proceedings of the Third Annual International Workshop on Active Middleware Services
Armada: A Parallel File System for Computational Grids

CCGRID '01 Proceedings of the 1st International Symposium on Cluster Computing and the Grid
Design of a Framework for Data-Intensive Wide-Area Applications

HCW '00 Proceedings of the 9th Heterogeneous Computing Workshop
A Component Based Services Architecture for Building Distributed Applications

HPDC '00 Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing
dQUOB: Managing Large Data Flows Using Dynamic Embedded Queries

HPDC '00 Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing
ACDS: Adapting Computational Data Streams for High Performance

IPDPS '00 Proceedings of the 14th International Symposium on Parallel and Distributed Processing
Multiple Query Optimization for Data Analysis Applications on Clusters of SMPs

CCGRID '02 Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid
Grid Information Services for Distributed Resource Sharing

HPDC '01 Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing
Dynamic function placement for data-intensive cluster computing

ATEC '00 Proceedings of the annual conference on USENIX Annual Technical Conference
ICP and the Squid web cache

IEEE Journal on Selected Areas in Communications

Optimizing the Execution of Multiple Data Analysis Queries on Parallel and Distributed Environments

IEEE Transactions on Parallel and Distributed Systems
Multiple range query optimization with distributed cache indexing

Proceedings of the 2006 ACM/IEEE conference on Supercomputing
Active semantic caching to optimize multidimensional data analysis in parallel and distributed environments

Parallel Computing
Grid query optimizer to improve query processing in grids

Future Generation Computer Systems
Multiple query scheduling for distributed semantic caches

Journal of Parallel and Distributed Computing
End-to-end quality of service for high-end applications

Computer Communications

Quantified Score

Hi-index	0.00

Visualization

Abstract

The Grid environment facilitates collaborative work and allows many users to query and process data over geographically dispersed data repositories. Over the past several years, there has been a growing interest in developing applications that interactively analyze datasets, potentially in a collaborative setting. We describe the Active Proxy-G service that is able to cache query results, use those results for answering new incoming queries, generate subqueries for the parts of a query that cannot be produced from the cache, and submit the subqueries for final processing at application servers that store the raw datasets. We present an experimental evaluation to illustrate the effects of various design tradeoffs. We also show the benefits that two real applications gain from using the middleware.