Addressing the petascale data challenge using in-situ analytics

Authors:
Manish Parashar
Affiliations:
Rutgers, The State University of New Jersey, Piscataway, NJ, USA
Venue:
Proceedings of the 2nd international workshop on Petascal data analytics: challenges and opportunities
Year:
2011

Citing 3
Cited 1

DataSpaces: an interaction and coordination framework for coupled simulation workflows

Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Moving the Code to the Data - Dynamic Code Deployment Using ActiveSpaces

IPDPS '11 Proceedings of the 2011 IEEE International Parallel & Distributed Processing Symposium
Enabling In-situ Execution of Coupled Scientific Workflow on Multi-core Platform

IPDPS '12 Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium

Using cross-layer adaptations for dynamic data management in large scale coupled scientific workflows

SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis

Quantified Score

Hi-index	0.00

Visualization

Abstract

Data management, processing and analysis costs are quickly dominating computational and data-enabled sciences, and are limiting the potential impacts of advanced simulations running at extreme scales on the high-end computing systems. This presentation explores how in-situ data analytics and in-transit data transformation and data manipulation can be used to address these data challenges at petascale and beyond. Specifically, this presentations describes solutions developed as part of the Rutgers Spaces Project and deployed within the ADIOS framework.