Do adaptation rules improve web cost estimation?
Proceedings of the fourteenth ACM conference on Hypertext and hypermedia
A Simulation Study of the Model Evaluation Criterion MMRE
IEEE Transactions on Software Engineering
Assessing Variation in Development Effort Consistency Using a Data Source with Missing Data
Software Quality Control
Reliability and Validity in Comparative Studies of Software Prediction Models
IEEE Transactions on Software Engineering
A Comparison of Software Project Overruns-Flexible versus Sequential Development Models
IEEE Transactions on Software Engineering
Exploring case-based reasoning for web hypermedia project cost estimation
International Journal of Web Engineering and Technology
Data sets and data quality in software engineering
Proceedings of the 4th international workshop on Predictor models in software engineering
Journal of Computational Methods in Sciences and Engineering - Selected papers from the International Conference on Computer Science,Software Engineering, Information Technology, e-Business, and Applications, 2003
A study of the non-linear adjustment for analogy based software cost estimation
Empirical Software Engineering
Quantifying IT forecast quality
Science of Computer Programming
A comparative study for estimating software development effort intervals
Software Quality Control
A COSMIC-FFP approach to predict web application development effort
Journal of Web Engineering
Hi-index | 0.00 |
The mean magnitude of relative error, MMRE, is the de facto standard evaluation criterion to assess the accuracy of software project prediction models. The fundamental metric of MMRE is MRE, a relative residual error. For MMRE to be a meaningful summary statistic, it is a necessary, but not sufficient, condition that MRE and project size are uncorrelated. Except for two previous conference studies done by the same authors, it has never been empirically validated that MRE and project size really are uncorrelated. In this paper, we extend the previous studies using the same data sets as before: Albrecht, Kemerer, Finnish, DMR and Accenture-ERP. Unlike the previous studies, we plot MRE against the predicted effort rather than against the actual effort and, in so doing, we obtain very different results from the previous studies. The results of this study suggest that MRE and project size are uncorrelated, which apparently is contradictory to the previous results where we found a negative correlation. The explanation for these seemingly contradictory results is presented in this study.