Parallel numerical algorithms based on tensor notation and Co-Array Fortran syntax

Authors:
Robert W. Numrich
Affiliations:
Minnesota Supercomputing Institute, University of Minnesota, Minneapolis, MN 55455, USA
Venue:
Parallel Computing
Year:
2005

Citing 5
Cited 6

Software libraries for linear algebra computations on high performance computers

SIAM Review
Co-array Fortran for parallel programming

ACM SIGPLAN Fortran Forum
High Performance Linear Algebra Package for FORTRAN 90

PARA '98 Proceedings of the 4th International Workshop on Applied Parallel Computing, Large Scale Scientific and Industrial Problems
Object Oriented Programming Via FORTRAN 90/95

Object Oriented Programming Via FORTRAN 90/95
Programming in Vienna Fortran

Scientific Programming

Co-arrays in the next Fortran Standard

Scientific Programming - Fortran Programming Language and Scientific Programming: 50 Years of Mutual Growth
Coarrays in the next Fortran standard

ACM SIGPLAN Fortran Forum
Multithreaded Global Address Space Communication Techniques for Gyrokinetic Fusion Applications on Ultra-Scale Platforms

Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
A parallel numerical library for co-array fortran

PPAM'05 Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics
A preliminary evaluation of the hardware acceleration of the Cray Gemini interconnect for PGAS languages and comparison with MPI

ACM SIGMETRICS Performance Evaluation Review
Computer performance analysis and the Pi Theorem

Computer Science - Research and Development

Quantified Score

Hi-index	0.00

Visualization

Abstract

Co-Array Fortran represents a correspondence between tensor notation and an extended Fortran array syntax. It uses normal Fortran array indices to point to data in local memory and adds co-array indices to point to data in remote memory. By writing algorithms according to the rules of tensor algebra, the programmer can transcribe a parallel algorithm directly into co-array syntax and can experiment with alternative communication patterns with full confidence that the algorithm is correct. Data communication is transparent in the notation itself and the syntax allows compilers to exploit low-latency hardware so that application codes scale well to large numbers of processors. Co-array syntax, combined with the object-oriented features of Fortran 90, is a powerful tool for designing and writing parallel algorithms. It raises the level of abstraction with little or no loss of performance.