Program parallelization using synchronized pipelining

• Authors: Leonardo Scandolo;César Kunz;Manuel Hermenegildo
• Venue: LOPSTR'09 Proceedings of the 19th international conference on Logic-Based Program Synthesis and Transformation
• Year: 2009

While there are well-understood methods for detecting loops whose iterations are independent and parallelizing them, there are comparatively fewer proposals that support parallel execution of a sequence of loops or nested loops in the case where such loops have dependencies among them. This paper introduces a refined notion of independence, called eventual independence, that in its simplest form considers two loops, say loop1 and loop2, and captures the idea that for every i there exists k such that the i+1-th iteration of loop2 is independent from the j-th iteration of loop1, for all j≥k. Eventual independence provides the foundation of a semantics-preserving program transformation, called synchronized pipelining, that makes execution of consecutive or nested loops parallel, relying on a minimal number of synchronization events to ensure semantics preservation. The practical benefits of synchronized pipelining are demonstrated through experimental results on common algorithms such as sorting and Fourier transforms.