An Externally Replicated Experiment for Evaluating the Learning Effectiveness of Using Simulations in Software Project Management Education

Authors:
Dietmar Pfahl;Oliver Laitenberger;Jörg Dorsch;Günther Ruhe
Affiliations:
Fraunhofer IESE, Germany pfahl@iese.fhg.de;Droege & Comp., Germany oliver_laitenberger@droege.de;Accenture, Germany joerg.dorsch@accenture.com;University of Calgary, Canada ruhe@ucalgary.ca
Venue:
Empirical Software Engineering
Year:
2003

Citing 7
Cited 5

Software project dynamics: an integrated approach

Software project dynamics: an integrated approach
Software-engineering process simulation model (SEPS)

Journal of Systems and Software
Software Engineering Economics

Software Engineering Economics
Software Cost Estimation with Cocomo II with Cdrom

Software Cost Estimation with Cocomo II with Cdrom
Introduction to System Dynamics Modeling with Dynamo

Introduction to System Dynamics Modeling with Dynamo
An Experimental Comparison of the Maintainability of Object-Orientedand Structured Design Documents

Empirical Software Engineering
An Experiment for Evaluating the Effectiveness of Using a System Dynamics Simulation Model in Software Project Management Education

METRICS '01 Proceedings of the 7th International Symposium on Software Metrics

A family of empirical studies to compare informal and optimization-based planning of software releases

Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
Management competences, not tools and techniques: A grounded examination of software project management at WM-data

Information and Software Technology
Risk analysis of software process measurements

Software Quality Control
Empirical evaluation of an educational game on software measurement

Empirical Software Engineering
Evaluating the impact of the QuARS requirements analysis tool using simulation

ICSP'07 Proceedings of the 2007 international conference on Software process

Quantified Score

Hi-index	0.00

Visualization

Abstract

The increasing demand for software project managers in industry requires strategies for the development of the management-related knowledge and skills of the current and future software workforce. Although several approaches help teach the required skills in a university setting, few empirical studies are currently available to characterize and compare their effects. This paper presents results of an externally replicated controlled experiment that evaluates the learning effectiveness of using a process simulation model for educating computer science students in software project management. While the experimental group applies a system dynamics (SD) simulation model, the control group uses the well-known COCOMO model as a predictive tool for project planning. The results of the empirical study indicate that students using the simulation model gain a better understanding about typical behavior patterns of software development projects. The combination of the results from the initial experiment and the replication corroborates this finding. Additional analysis shows that the observed effect can mainly be attributed to the use of the simulation model in combination with a web-based role-play scenario. This finding is strongly supported by information gathered from the debriefing questionnaires of subjects in the experimental group. They consistently rated the simulation-based role-play scenario as a very useful approach for learning about issues in software project management.