Change search
ReferencesLink to record
Permanent link

Direct link
Evaluation and Measurement of Software Process Improvement: A Systematic Literature Review
Blekinge Institute of Technology, School of Computing.
Blekinge Institute of Technology, School of Computing.
Show others and affiliations
Responsible organisation
2012 (English)In: IEEE Transactions on Software Engineering, ISSN 0098-5589, E-ISSN 1939-3520, Vol. 38, no 2, 398-424 p.Article in journal (Refereed) Published
Abstract [en]

Software Process Improvement (SPI) is a systematic approach to increase the efficiency and effectiveness of a software development organization and to enhance software products. OBJECTIVE—This paper aims to identify and characterize evaluation strategies and measurements used to assess the impact of different SPI initiatives. METHOD--The systematic literature review includes 148 papers published between 1991 and 2008. The selected papers were classified according to SPI initiative, applied evaluation strategies and measurement perspectives. Potential confounding factors interfering with the evaluation of the improvement effort were assessed. RESULTS--Seven distinct evaluation strategies were identified, whereas the most common one, "Pre-Post Comparison", was applied in 49% of the inspected papers. Quality was the most measured attribute (62%), followed by Cost (41%) and Schedule (18%). Looking at measurement perspectives, "Project" represents the majority with 66%. CONCLUSION—The evaluation validity of SPI initiatives is challenged by the scarce consideration of potential confounding factors, particularly given that "Pre-Post Comparison" was identified as the most common evaluation strategy, and the inaccurate descriptions of the evaluation context. Measurements to assess the short and mid-term impact of SPI initiatives prevail, whereas long-term measurements in terms of customer satisfaction and return on investment tend to be less used.

Place, publisher, year, edition, pages
IEEE , 2012. Vol. 38, no 2, 398-424 p.
Keyword [en]
Process implementation and change, Process measurement, Metrics/Measurement, Systematic Literature Review
National Category
Software Engineering
URN: urn:nbn:se:bth-7122DOI: 10.1109/TSE.2011.26ISI: 000301915200010Local ID: diva2:834704

Available from: 2012-12-05 Created: 2011-06-14 Last updated: 2016-09-06Bibliographically approved

Open Access in DiVA

fulltext(1022 kB)276 downloads
File information
File name FULLTEXT01.pdfFile size 1022 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Unterkalmsteiner, MichaelGorschek, TonyFeldt, Robert
By organisation
School of Computing
In the same journal
IEEE Transactions on Software Engineering
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 276 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 62 hits
ReferencesLink to record
Permanent link

Direct link