Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Application of Topic Models for Test Case Selection: A comparison of similarity-based selection techniques
Linköping University, Department of Computer and Information Science, Software and Systems.
2019 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesisAlternative title
Tillämpning av ämnesmodeller för testfallsselektion (Swedish)
Abstract [en]

Regression testing is just as important for the quality assurance of a system, as it is time consuming. Several techniques exist with the purpose of lowering the execution times of test suites and provide faster feedback to the developers, examples are ones based on transition-models or string-distances. These techniques are called test case selection (TCS) techniques, and focuses on selecting subsets of the test suite deemed relevant for the modifications made to the system under test.

This thesis project focused on evaluating the use of a topic model, latent dirichlet allocation, as a means to create a diverse selection of test cases for coverage of certain test characteristics. The model was tested on authentic data sets from two different companies, where the results were compared against prior work where TCS was performed using similarity-based techniques. Also, the model was tuned and evaluated, using an algorithm based on differential evolution, to increase the model’s stability in terms of inferred topics and topic diversity.

The results indicate that the use of the model for test case selection purposes was not as efficient as the other similarity-based selection techniques studied in work prior to thist hesis. In fact, the results show that the selection generated using the model performs similar, in terms of coverage, to a randomly selected subset of the test suite. Tuning of the model does not improve these results, in fact the tuned model performs worse than the other methods in most cases. However, the tuning process results in the model being more stable in terms of inferred latent topics and topic diversity. The performance of the model is believed to be strongly dependent on the characteristics of the underlying data used to train the model, putting emphasis on word frequencies and the overall sizes of the training documents, and implying that this would affect the words’ relevance scoring to the better.

Place, publisher, year, edition, pages
2019. , p. 48
Keywords [en]
test automation, test case selection, machine learning, latent dirichlet allocation, differential evolution
Keywords [sv]
testautomation, testfallsselektion, maskininlärning, latent dirichlet allocation, differentiell evolution
National Category
Computer Systems
Identifiers
URN: urn:nbn:se:liu:diva-159803ISRN: LIU-IDA/LITH-EX-A--19/048--SEOAI: oai:DiVA.org:liu-159803DiVA, id: diva2:1344833
External cooperation
Altran AB
Subject / course
Computer Engineering
Supervisors
Examiners
Available from: 2019-09-03 Created: 2019-08-22 Last updated: 2019-09-03Bibliographically approved

Open Access in DiVA

fulltext(1482 kB)585 downloads
File information
File name FULLTEXT01.pdfFile size 1482 kBChecksum SHA-512
fab7350eaeeb562faddd58f9ae4d57b95b7f14826d28e075187ad277c5335af3e05acacaf93acbe168ba5ef8c0f29f4049b610cddef216510602954b8a7a10d3
Type fulltextMimetype application/pdf

By organisation
Software and Systems
Computer Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 585 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 506 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf