Improving access to precipitation data for GIS users: designing for ease of use
EMS '07 Proceedings of the Third IASTED International Conference on Environmental Modelling and Simulation
Tropical cyclone event sequence similarity search via dimensionality reduction and metric learning
Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
A framework for moving sensor data query and retrieval of dynamic atmospheric events
SSDBM'10 Proceedings of the 22nd international conference on Scientific and statistical database management
Taking Advantage of Federated Cloud Storage and Multi-core Technology in Content Delivery
UCC '13 Proceedings of the 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing
Hi-index | 0.00 |
One of the world's largest scientific data systems, NASA's Earth Observing System Data and Information System (EOSDIS) has stored over three petabytes of earth science data in a geographically distributed mass storage system. Design for this system began in the early 1990s and included a presentation of the design of the mass storage system at this conference in 1995. Many changes have occurred in the ten years since that presentation, much of it performed while the system was operational. In its first operational year (2000), the EOSDIS system had increased NASA's collection of earth science data holdings eight-fold. Today, EOSDIS collects over 7,000 gigabytes of data per week, almost 60 times more than the Hubble Space Telescope. This load represents major challenges for ingest into the mass storage system, as well as for timely and balanced data distribution out of the mass storage system. This paper discusses the evolution of the EOSDIS archives focusing primarily on the mass storage system component of the archive. We present the lessons that were learned over the years and some directions that we are taking for the future.