Change search
ReferencesLink to record
Permanent link

Direct link
Systematic Review on Automated Testing (Types, Effort and ROI)
Linköping University, Department of Computer and Information Science. Linköping University, The Institute of Technology. (Software Engineering and Theory)
2014 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

Software organizations always want to build software by minimizing their resources to reduce overall cost and by maintaining high quality to produce reliable software. Software testing helps us to achieve these goals in this regard. Software testing can be manual or automated. Manual testing is a very expensive activity. It takes much time to write test cases and run them one by one. It can be error-prone due to much involvement of human throughout the process. Automated testing reduces the testing time which results in reduction of overall software cost as well as it provides other benefits i.e. early time to market, improved quality. Organizations are willing to invest in test automation. Before investment, they want to know the expected cost and benefits for AST. Effort is the main factor, which increase the cost of testing.  


In this thesis, a systematic review have been conducted which identifies and summarizes  all the retrieved research concerning the automated testing types, effort estimation and return on investment (ROI) / cost-benefit analysis for automated testing. To conduct the systematic review, the author has developed a comprehensive plan which follows the procedure presented in [15]. This plan provides guidance to identify relevant research articles of a defined period. After the identification of research articles, it collects, evaluates and then interprets all the retrieved data about automated testing types, effort estimation and ROI. The results have been presented in statistical and descriptive form which provides different aspects of the data.  


The statistical results have been presented with the help of tables and graphs which show different aspects of data i.e. any gaps in research work of automated testing, number of articles for each testing type. The answers of the questions have been presented in descriptive form. The descriptive results show 22 automated testing types, 17 Industrial case studies out of 60 studies, benefits of automated testing and effort estimation models. The discussion part highlighted some important facts about the retrieved data and provides practical implications for conducting systematic reviews. Finally it is concluded that systematic reviews are good means of finding and analyzing research data about a topic, phenomena and area of interest. It also provides support to researchers for conducting and investigating more research.  

Place, publisher, year, edition, pages
2014. , 48 p.
National Category
Computer Systems
URN: urn:nbn:se:liu:diva-105779ISRN: LIU-IDA/LITH-EX-A--14/004--SEOAI: diva2:710179
Subject / course
Computer and information science at the Institute of Technology
2014-01-28, Linköping, 15:15 (English)
Available from: 2014-04-07 Created: 2014-04-04 Last updated: 2014-04-07Bibliographically approved

Open Access in DiVA

fulltext(1240 kB)363 downloads
File information
File name FULLTEXT01.pdfFile size 1240 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Muneer, Imran
By organisation
Department of Computer and Information ScienceThe Institute of Technology
Computer Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 363 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 343 hits
ReferencesLink to record
Permanent link

Direct link