Change search
ReferencesLink to record
Permanent link

Direct link
The Evaluation of Well-known Effort Estimation Models based on Predictive Accuracy Indicators
Blekinge Institute of Technology, School of Computing.
2010 (English)Independent thesis Advanced level (degree of Master (Two Years))Student thesis
Abstract [en]

Accurate and reliable effort estimation is still one of the most challenging processes in software engineering. There have been numbers of attempts to develop cost estimation models. However, the evaluation of model accuracy and reliability of those models have gained interest in the last decade. A model can be finely tuned according to specific data, but the issue remains there is the selection of the most appropriate model. A model predictive accuracy is determined by the difference of the various accuracy measures. The one with minimum relative error is considered to be the best fit. The model predictive accuracy is needed to be statistically significant in order to be the best fit. This practice evolved into model evaluation. Models predictive accuracy indicators need to be statistically tested before taking a decision to use a model for estimation. The aim of this thesis is to statistically evaluate well known effort estimation models according to their predictive accuracy indicators using two new approaches; bootstrap confidence intervals and permutation tests. In this thesis, the significance of the difference between various accuracy indicators were empirically tested on the projects obtained from the International Software Benchmarking Standard Group (ISBSG) data set. We selected projects of Un-Adjusted Function Points (UFP) of quality A. Then, the techniques; Analysis Of Variance ANOVA and regression to form Least Square (LS) set and Estimation by Analogy (EbA) set were used. Step wise ANOVA was used to form parametric model. K-NN algorithm was employed in order to obtain analogue projects for effort estimation use in EbA. It was found that the estimation reliability increased with the pre-processing of the data statistically, moreover the significance of the accuracy indicators were not only tested statistically but also with the help of more complex inferential statistical methods. The decision of selecting non-parametric methodology (EbA) for generating project estimates in not by chance but statistically proved.

Place, publisher, year, edition, pages
2010. , 94 p.
Keyword [en]
Measurement, models evaluation, global accuracy measures, bootstrap confidence intervals, ISBSG data set.
National Category
Discrete Mathematics Probability Theory and Statistics Software Engineering
URN: urn:nbn:se:bth-4778Local ID: diva2:832126
Physics, Chemistry, Mathematics
Available from: 2015-04-22 Created: 2010-03-08 Last updated: 2015-06-30Bibliographically approved

Open Access in DiVA

fulltext(1108 kB)174 downloads
File information
File name FULLTEXT01.pdfFile size 1108 kBChecksum SHA-512
Type fulltextMimetype application/pdf

By organisation
School of Computing
Discrete MathematicsProbability Theory and StatisticsSoftware Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 174 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 24 hits
ReferencesLink to record
Permanent link

Direct link