Evaluating cloud computing in the NASA DESDynI ground data system

Authors:
John J. Tran;Luca Cinquini;Chris A. Mattmann;Paul A. Zimdars;David T. Cuddy;Kon S. Leung;Oh-Ig Kwoun;Dan Crichton;Dana Freeborn
Affiliations:
California Institute of Technology & University of Southern California, Pasadena & Los Angeles, CA, USA;California Institute of Technology, Pasadena, CA, USA;California Institute of Technology & University of Southern California, Pasadena & Los Angeles, CA, USA;California Institute of Technology, Pasadena, CA, USA;California Institute of Technology, Pasadena, CA, USA;California Institute of Technology, Pasadena, CA, USA;California Institute of Technology, Pasadena, CA, USA;California Institute of Technology, Pasadena, CA, USA;California Institute of Technology, Pasadena, CA, USA
Venue:
Proceedings of the 2nd International Workshop on Software Engineering for Cloud Computing
Year:
2011

Citing 10
Cited 1

Data Management: NetCDF: an Interface for Scientific Data Access

IEEE Computer Graphics and Applications
Supporting Configurable Congestion Control in Data Transport Services

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
A software architecture-based framework for highly distributed and data intensive scientific applications

Proceedings of the 28th international conference on Software engineering
Scientific Software as Workflows: From Discovery to Distribution

IEEE Software
Eventually consistent

Communications of the ACM - Rural engineering development
On the Use of Cloud Computing for Scientific Workflows

ESCIENCE '08 Proceedings of the 2008 Fourth IEEE International Conference on eScience
A Reusable Process Control System Framework for the Orbiting Carbon Observatory and NPP Sounder PEATE Missions

SMC-IT '09 Proceedings of the Third IEEE International Conference on Space Mission Challenges for Information Technology
Cumulus: Filesystem backup to the cloud

ACM Transactions on Storage (TOS)
How replicated data management in the cloud can benefit from a data grid protocol: the Re:GRIDiT Approach

Proceedings of the first international workshop on Cloud data management
Experiments with Storage and Preservation of NASA's Planetary Data via the Cloud

IT Professional

Green streams for data-intensive software

Proceedings of the 2013 International Conference on Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

The proposed NASA Deformation, Ecosystem Structure and Dynamics of Ice (DESDynI) mission would be a first-of-breed endeavor that would fundamentally change the paradigm by which Earth Science data systems at NASA are built. DESDynI is evaluating a distributed architecture where expert science nodes around the country all engage in some form of mission processing and data archiving. This is compared to the traditional NASA Earth Science missions where the science processing is typically centralized. What's more, DESDynI is poised to profoundly increase the amount of data collection and processing well into the 5 terabyte/day and tens of thousands of job range, both of which comprise a tremendous challenge to DESDynI's proposed distributed data system architecture. In this paper, we report on a set of architectural trade studies and benchmarks meant to inform the DESDynI mission and the broader community of the impacts of these unprecedented requirements. In particular, we evaluate the benefits of cloud computing and its integration with our existing NASA ground data system software called Apache Object Oriented Data Technology (OODT). The preliminary conclusions of our study suggest that the use of the cloud and OODT together synergistically form an effective, efficient and extensible combination that could meet the challenges of NASA science missions requiring DESDynI-like data collection and processing volumes at reduced costs.