Accelerating tropical cyclone analysis using LambdaRAM, a distributed data cache over wide-area ultra-fast networks

  • Authors:

  • Venkatram Vishwanath;Robert Burns;Jason Leigh;Michael Seablom

  • Affiliations:

  • Electronic Visualization Laboratory (EVL), University of Illinois at Chicago (UIC), United States;Software Integration and Visualization Office (SIVO), National Aeronautics and Space Administration (NASA), Goddard Space Flight Center (GSFC), MD, United States;Electronic Visualization Laboratory (EVL), University of Illinois at Chicago (UIC), United States;Software Integration and Visualization Office (SIVO), National Aeronautics and Space Administration (NASA), Goddard Space Flight Center (GSFC), MD, United States

  • Venue:
  • Future Generation Computer Systems
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Data-intensive scientific applications require rapid access to local and geographically distributed data, however, there are significant I/O latency bottlenecks associated with storage systems and wide-area networking. LambdaRAM is a high-performance, multi-dimensional, distributed cache, that takes advantage of memory from multiple clusters interconnected by ultra-high-speed networking, to provide applications with rapid access to both local and remote data. It mitigates latency bottlenecks by employing proactive latency-mitigation heuristics based on an application's access patterns. We present results using LambdaRAM to rapidly stride through remote multi-dimensional NASA Modeling, Analysis and Prediction (MAP) 2006 project datasets, based on time and geographical coordinates, to compute wind shear for cyclone and hurricane and tropical cyclone analysis. Our current experiments have demonstrated up to a 20-fold speedup in the computation of wind shear with LambdaRAM.