A Simulation of Seismic Wave Propagation at High Resolution in the Inner Core of the Earth on 2166 Processors of MareNostrum

Authors:
Dimitri Komatitsch;Jesús Labarta;David Michéa
Affiliations:
Université de Pau et des Pays de l'Adour, CNRS UMR 5212 & INRIA Sud-Ouest Magique-3D, Pau Cedex, France 64013 and Institut universitaire de France, Paris, France 75005;Barcelona Supercomputing Center, Technical University of Catalonia, Barcelona, Spain 08034;Université de Pau et des Pays de l'Adour, CNRS UMR 5212 & INRIA Sud-Ouest Magique-3D, Pau Cedex, France 64013
Venue:
High Performance Computing for Computational Science - VECPAR 2008
Year:
2008

Citing 5
Cited 4

Nonlinear dynamic finite element analysis on parallel computers using FORTRAN 90 and MPI

Advances in Engineering Software - Special issue; special issue on large-scale analysis and design on high-performance computers and workstations
Reducing the bandwidth of sparse symmetric matrices

ACM '69 Proceedings of the 1969 24th national conference
Performance Analysis of Multilevel Parallel Applications on Shared Memory Architectures

IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
Solving elastodynamics in a fluid-solid heterogeneous sphere: a parallel spectral element approximation on non-conforming grids

Journal of Computational Physics
A 14.6 billion degrees of freedom, 5 teraflops, 2.5 terabyte earthquake simulation on the Earth Simulator

Proceedings of the 2003 ACM/IEEE conference on Supercomputing

Simulation of Seismic Wave Propagation in an Asteroid Based upon an Unstructured MPI Spectral-Element Method: Blocking and Non-blocking Communication Strategies

High Performance Computing for Computational Science - VECPAR 2008
A survey of the practice of computational science

State of the Practice Reports
Simulation of multistage excavation based on a 3D spectral-element method

Computers and Structures
Energy efficiency vs. performance of the numerical solution of PDEs: An application study on a low-power ARM-based cluster

Journal of Computational Physics

Quantified Score

Hi-index	0.00

Visualization

Abstract

We use 2166 processors of the MareNostrum (IBM PowerPC 970) supercomputer to model seismic wave propagation in the inner core of the Earth following an earthquake. Simulations are performed based upon the spectral-element method, a high-degree finite-element technique with an exactly diagonal mass matrix. We use a mesh with 21 billion grid points (and therefore approximately 21 billion degrees of freedom because a scalar unknown is used in most of the mesh). A total of 2.5 terabytes of memory is needed. Our implementation is purely based upon MPI. We optimize it using the ParaVer analysis tool in order to significantly improve load balancing and therefore overall performance. Cache misses are reduced based upon renumbering of the mesh points.