Meandre data-intensive application infrastructure: extreme scalability for cloud and/or grid computing

Authors:
Bernie Ács;Xavier Llorà;Boris Capitanu;Loretta Auvil;David Tcheng;Mike Haberman;Limin Dong;Tim Wentling;Michael Welge
Affiliations:
National Center for Supercomputing Applications, University of Illinois at Urbana-Champaign, Urbana, IL;National Center for Supercomputing Applications, University of Illinois at Urbana-Champaign, Urbana, IL;National Center for Supercomputing Applications, University of Illinois at Urbana-Champaign, Urbana, IL;National Center for Supercomputing Applications, University of Illinois at Urbana-Champaign, Urbana, IL;National Center for Supercomputing Applications, University of Illinois at Urbana-Champaign, Urbana, IL;National Center for Supercomputing Applications, University of Illinois at Urbana-Champaign, Urbana, IL;National Center for Supercomputing Applications, University of Illinois at Urbana-Champaign, Urbana, IL;National Center for Supercomputing Applications, University of Illinois at Urbana-Champaign, Urbana, IL;National Center for Supercomputing Applications, University of Illinois at Urbana-Champaign, Urbana, IL
Venue:
JSAI-isAI'10 Proceedings of the 2010 international conference on New Frontiers in Artificial Intelligence
Year:
2010

Citing 6
Cited 0

Design of a Framework for Data-Intensive Wide-Area Applications

HCW '00 Proceedings of the 9th Heterogeneous Computing Workshop
The virtual data grid: a new model and architecture for data-intensive collaboration

SSDBM '03 Proceedings of the 15th International Conference on Scientific and Statistical Database Management
MapReduce: simplified data processing on large clusters

OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Meandre: Semantic-Driven Data-Intensive Flows in the Clouds

ESCIENCE '08 Proceedings of the 2008 Fourth IEEE International Conference on eScience
Scala Actors: Unifying thread-based and event-based programming

Theoretical Computer Science
A general approach to data-intensive computing using the Meandre component-based framework

Proceedings of the 1st International Workshop on Workflow Approaches to New Data-centric Science

Quantified Score

Hi-index	0.00

Visualization

Abstract

The volumes and velocity of data are growing at unprecedented rates, often physically distributed, have access constraints, and requirements to leverage the diverse computational fabrics like clouds and grids. The Meandre data-intensive component-based application infrastructure can leverage diversity and enables extremely scalable server clusters and applications to address these challenges. Data-intensive flows can: be web-services and/or computational tasks; co-locate processing with data; orchestrate cloud computing resources; and leverage grid resources with distributed execution. Meandre from a laptop to a cloud, grid, or server as analytical computational tasks and/or web-services in data-intensive flows made up of components that provide deployment and execution strategies for extreme scalability.