Change search
ReferencesLink to record
Permanent link

Direct link
Analysis of Test Coverage Data on a Large-Scale Industrial System
Linköping University, Department of Computer and Information Science, Software and Systems.
2016 (English)Independent thesis Basic level (degree of Bachelor), 10,5 credits / 16 HE creditsStudent thesis
Abstract [en]

Software testing verifies the program's functional behavior, one important process when engineering critical software. Measuring the degree of testing is done with code coverage, describing the amount of production code affected by tests. Both concepts are extensively used for industrial systems. Previous research has shown that gathering and analyzing test coverages becomes problematic on large-scale systems. Here, development experience, implementation feasibility, coverage measurements and analysis method are explored; providing potential solutions and insights into these issues.

Outlined are methods for constructing and integrating such gathering and analysis system in a large-scale project, along with the problems encountered and given remedies. Instrumentations for gathering coverage information affect performance negatively, these measurements are provided. Since large-scale test suite measurements are quite lacking, the line, branch, and function criteria are presented here. Finally, an analysis method is proposed, by using coverage set operations and Jaccard indices, to find test similarities.

Results gathered imply execution time was significantly affected when gathering coverage, [2.656, 2.911] hours for instrumented software, originally between [2.075, 2.260] on the system under test, given under the alpha = 5% and n = 4, while both processor & memory usages were inconclusive. Measured criteria were (59.3, 70.7, 24.6)% for these suites. Analysis method shows potential areas of test redundancy.

Place, publisher, year, edition, pages
2016. , 38 p.
Keyword [en]
code coverage, software testing, industrial, analysis, large-scale, similarity, jaccard, implementation, feasibility, performance
National Category
Software Engineering Computer Science
URN: urn:nbn:se:liu:diva-131815ISRN: LIU-IDA/LITH-EX-G--16/067--SEOAI: diva2:1033661
External cooperation
Ericsson AB
Subject / course
Computer Engineering
2016-09-23, Alan Turing, Campus Valla, Linköping University, Linköping, 10:15 (English)
Available from: 2016-10-10 Created: 2016-10-07 Last updated: 2016-10-11Bibliographically approved

Open Access in DiVA

atcdlsis(1538 kB)20 downloads
File information
File name FULLTEXT01.pdfFile size 1538 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Vasconcelos Jansson, Erik Sven
By organisation
Software and Systems
Software EngineeringComputer Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 20 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

ReferencesLink to record
Permanent link

Direct link