Estimation of information systems development efforts: a pilot study
Information and Management
Impact of experience on maintenance skills
Journal of Software Maintenance: Research and Practice
The Standish report: does it really describe a software crisis?
Communications of the ACM - Music information retrieval
Agile customer engagement: a longitudinal qualitative case study
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
The impact of size and volatility on IT project performance
Communications of the ACM
Effective software management: where do we falter?
SEPADS'07 Proceedings of the 6th WSEAS International Conference on Software Engineering, Parallel and Distributed Systems
Proceedings of the 2008 ACM SIGMIS CPR conference on Computer personnel doctoral consortium and research
A survey on software cost estimation in the chinese software industry
Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement
Business rules for semantics-aware business modelling: overview and open issues
International Journal of Web Engineering and Technology
Software, software engineering and software engineering research: some unconventional thoughts
Journal of Computer Science and Technology
Communications of the ACM - Finding the Fun in Computer Science Education
Evaluating logistic regression models to estimate software project outcomes
Information and Software Technology
The optimization of success probability for software projects using genetic algorithms
Journal of Systems and Software
Information and Software Technology
Human judgement and software metrics: vision for the future
Proceedings of the 2nd International Workshop on Emerging Trends in Software Metrics
Information and Software Technology
A follow-up empirical evaluation of evidence based software engineering by undergraduate students
EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering
Evaluating prediction systems in software project estimation
Information and Software Technology
PROFES'12 Proceedings of the 13th international conference on Product-Focused Software Process Improvement
Hi-index | 0.02 |
The Standish Group reported in their 1994 CHAOS report that the average cost overrun of software projects was as high as 189%. This figure for cost overrun is referred to frequently by scientific researchers, software process improvement consultants, and government advisors. In this paper, we review the validity of the Standish Group's 1994 cost overrun results. Our review is based on a comparison of the 189% cost overrun figure with the cost overrun figures reported in other cost estimation surveys, and an examination of the Standish Group's survey design and analysis methods. We find that the figure reported by the Standish Group is much higher than those reported in similar estimation surveys and that there may be severe problems with the survey design and methods of analysis, e.g. the population sampling method may be strongly biased towards 'failure projects'. We conclude that the figure of 189% for cost overruns is probably much too high to represent typical software projects in the 1990s and that a continued use of that figure as a reference point for estimation accuracy may lead to poor decision making and hinder progress in estimation practices.