A cloud-based workflow management solution for collaborative analytics

Authors:
Henry Kasim;Terence Hung;Xiaorong Li;William-Chandra Tjhi;Sifei Lu;Long Wang
Affiliations:
Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR), Singapore;Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR), Singapore;Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR), Singapore;Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR), Singapore;Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR), Singapore;Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR), Singapore
Venue:
ICSOC'11 Proceedings of the 2011 international conference on Service-Oriented Computing
Year:
2011

Citing 2
Cited 1

Hybrid Heuristic for Scheduling Data Analytics Workflow Applications in Hybrid Cloud Environment

IPDPSW '11 Proceedings of the 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and PhD Forum
Meta-data: characterization of input features for meta-learning

MDAI'05 Proceedings of the Second international conference on Modeling Decisions for Artificial Intelligence

Collaborative analytics for predicting expressway-traffic congestion

Proceedings of the 14th Annual International Conference on Electronic Commerce

Quantified Score

Hi-index	0.00

Visualization

Abstract

The concept of collaborative analytics is to accommodate reuse and collaboration in data analysis process through sharing of analytics methods, algorithms, and computation resources. However, realizing collaborative analytics is challenging due to the large data sets, high throughput and computational intensive requirements. In this demonstration, we present a cloud-based workflow management solution that allows collaborative analytics to run in the cloud computing environment. Our solution provides sharing of analytics resources, recommendation of analytic workflows, dynamic scheduling and provisioning for scalable data analytics, high availability through fault-tolerance, real-time monitoring and tracking of collaborative analytics status. Examples of a generic data mining analysis and climate change analytics are given to show that our work can be applied for a wide variety of study in the real-life world.