Parallel Programmer Productivity: A Case Study of Novice Parallel Programmers

Authors:
Lorin Hochstein;Jeff Carver;Forrest Shull;Sima Asgari;Victor Basili;Jeffrey K. Hollingsworth;Marvin V. Zelkowitz
Affiliations:
University of Maryland, College Park;Mississippi State University;Fraunhofer Center Maryland;University of Maryland, College Park;Fraunhofer Center Maryland;University of Maryland, College Park;University of Maryland, College Park and Fraunhofer Center Maryland
Venue:
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Year:
2005

Citing 7
Cited 24

Experimental Evaluation of a Reusability-Oriented Parallel Programming Environment

IEEE Transactions on Software Engineering
Explicit multi-threading (XMT) bridging models for instruction parallelism (extended abstract)

Proceedings of the tenth annual ACM symposium on Parallel algorithms and architectures
A comparative study of the NAS MG benchmark across parallel languages and architectures

Proceedings of the 2000 ACM/IEEE conference on Supercomputing
A framework for performance modeling and prediction

Proceedings of the 2002 ACM/IEEE conference on Supercomputing
A General Predictive Performance Model for Wavefront Algorithms on Clusters of SMPs

ICPP '00 Proceedings of the Proceedings of the 2000 International Conference on Parallel Processing
Issues in Using Students in Empirical Studies in Software Engineering Education

METRICS '03 Proceedings of the 9th International Symposium on Software Metrics
Combining self-reported and automatic data to improve programming effort measurement

Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering

Software Development Environments for Scientific and Engineering Software: A Series of Case Studies

ICSE '07 Proceedings of the 29th international conference on Software Engineering
Performance Measurement of Novice HPC Programmers Code

SE-HPC '07 Proceedings of the 3rd International Workshop on Software Engineering for High Performance Computing Applications
Beyond Performance Tools: Measuring and Modeling Productivity in HPC

SE-HPC '07 Proceedings of the 3rd International Workshop on Software Engineering for High Performance Computing Applications
Type-safe higher-order channels in ML-like languages

ICFP '07 Proceedings of the 12th ACM SIGPLAN international conference on Functional programming
Empirical studies to build a science of computer science

Communications of the ACM
The role of MPI in development time: a case study

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
An Experimental Evaluation of the New OpenMP Tasking Model

Languages and Compilers for Parallel Computing
Type-safe higher-order channels with channel locality1

Journal of Functional Programming
A breadth-first course in multicore and manycore programming

Proceedings of the 41st ACM technical symposium on Computer science education
The role of controlled experiments in software engineering research

Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
The last mile: parallel programming and usability

Proceedings of the FSE/SDP workshop on Future of software engineering research
Automatic Parallelization in a Binary Rewriter

MICRO '43 Proceedings of the 2010 43rd Annual IEEE/ACM International Symposium on Microarchitecture
User evaluation of correctness conditions: a case study of cooperability

Evaluation and Usability of Programming Languages and Tools
Three layer cake for shared-memory programming

Proceedings of the 2010 Workshop on Parallel Programming Patterns
Mental models and parallel program maintenance

Proceedings of the 33rd International Conference on Software Engineering
An idiom-finding tool for increasing productivity of accelerators

Proceedings of the international conference on Supercomputing
Localizing globals and statics to make C programs thread-safe

CASES '11 Proceedings of the 14th international conference on Compilers, architectures and synthesis for embedded systems
A balanced approach to application performance tuning

LCPC'09 Proceedings of the 22nd international conference on Languages and Compilers for Parallel Computing
Mojave: a development environment for the Cactus computational framework

Proceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment: Bridging from the eXtreme to the campus and beyond
Combining functional and imperative programming for multicore software: an empirical study evaluating Scala and Java

Proceedings of the 34th International Conference on Software Engineering
HARPPIE: hyper algorithmic recipe for productive parallelism intensive endeavors

Proceedings of the 34th International Conference on Software Engineering
From physics model to results: an optimizing framework for cross-architecture code generation

Proceedings of the Extreme Scaling Workshop
Examining the expert gap in parallel programming

Euro-Par'13 Proceedings of the 19th international conference on Parallel Processing
From physics model to results: An optimizing framework for cross-architecture code generation

Scientific Programming

Quantified Score

Hi-index	0.03

Visualization

Abstract

In developing High-Performance Computing (HPC) software, time to solution is an important metric. This metric is comprised of two main components: the human effort required developing the software, plus the amount of machine time required to execute it. To date, little empirical work has been done to study the first component: the human effort required and the effects of approaches and practices that may be used to reduce it. In this paper, we describe a series of studies that address this problem. We instrumented the development process used in multiple HPC classroom environments. We analyzed data within and across such studies, varying factors such as the parallel programming model used and the application being developed, to understand their impact on the development process.