SETI@home: an experiment in public-resource computing
Communications of the ACM
Revised Papers from the NETWORKING 2002 Workshops on Web Engineering and Peer-to-Peer Computing
BOINC: A System for Public-Resource Computing and Storage
GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
From Sandbox to Playground: Dynamic Virtual Environments in the Grid
GRID '04 Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing
The Computational and Storage Potential of Volunteer Computing
CCGRID '06 Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid
How to measure a large open-source distributed system: Research Articles
Concurrency and Computation: Practice & Experience
Interactive TV Standards: A Guide to MHP, OCAP, and JavaTV
Interactive TV Standards: A Guide to MHP, OCAP, and JavaTV
TVGrid: A Grid Architecture to use the idle resources on a Digital TV network
CCGRID '07 Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid
Automatic grid assembly by promoting collaboration in peer-to-peer grids
Journal of Parallel and Distributed Computing
Falkon: a Fast and Light-weight tasK executiON framework
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Toward loosely coupled programming on petascale systems
Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Design and implementation of "many parallel task" hybrid subsurface model
Proceedings of the 2011 ACM international workshop on Many task computing on grids and supercomputers
OddCI-Ginga: A Platform for High Throughput Computing Using Digital TV Receivers
GRID '12 Proceedings of the 2012 ACM/IEEE 13th International Conference on Grid Computing
| Hi-index | 0.00 |
The availability of large quantities of processors is a crucial enabler of many-task computing. Voluntary computing systems have proven that it is possible to build computing platforms with millions of nodes to support the execution of embarrassingly parallel applications. These systems, however, lack the flexibility of more traditional grid infrastructures. On the other hand, flexible infrastructures currently available can gather only dozens of thousands nodes. We propose a novel architecture for generic Distributed Computing Infrastructures (DCI) that can be instantiated on demand to be, at the same time, flexible and highly-scalable. Bringing the scalability from voluntary computing, the flexibility from grid computing and the elasticity from cloud computing in a single arrangement, our proposal allows for fast setup, fast initialization and fast dismantle of customized DCI supported by both dedicated and shared underlying infrastructures. Our approach leverages broadcast communication as an efficient mechanism to enable aggregation of geographically distributed computing resources, including millions of non-traditional processing devices such as PDA, mobile phones and Digital TV receivers, using both opportunistic and non-opportunistic models. We show the feasibility of the proposed architecture by implementing it atop a digital television system. We also assess the performance of such system and show that it can be used to execute several classes of many-tasks computing applications with very high efficiency, substantially decreasing their response time.