Change search
ReferencesLink to record
Permanent link

Direct link
Parallelize Automated Tests in a Build and Test Environment
Linköping University, Department of Computer and Information Science, Software and Systems.
2016 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

This thesis investigates the possibilities of finding solutions, in order to reduce the total time spent for testing and waiting times for running multiple automated test cases in a test framework. The “Automated Test Framework”, developed by Axis Communications AB, is used to write the functional tests to test both hardware and software of a resource. The functional tests that tests the software is considered in this thesis work. In the current infrastructure, tests are executed sequentially and resources are allocated using First In First Out scheduling algorithm. From the user’s point of view, it is inefficient to wait for many hours to run their tests that take few minutes to execute. The thesis consists of two main parts: (1) identify a plugin that suits the framework and executes the tests in parallel, which reduces the overall execution time of tests and (2) analyze various scheduling algorithms in order to address the resource allocation problem, which arose due to limited resource availability, while the tests were run in parallel. By distributing multiple tests across several resources and executing them in parallel, help in improving the test strategy, thereby reducing the overall execution times of test suites. The case studies were created to emulate the problematic scenarios in the company and sample tests were written that reflect the real tests in the framework. Due to the complexity of the current architecture and the limited resources available for running the test in parallel, a simulator was developed with the identified plugin in a multi-core computer, with each core simulating a resource. Multiple tests were run using the simulator in order to explore, check and assess if the overall execution time of the tests can be reduced. While achieving parallelism in running the automated tests, resource allocation became a problem, since limited resources are available to run parallel tests. In order to address this problem, scheduling algorithms were considered. A prototype was developed to mimic the behaviour of a scheduling plugin and the scheduling algorithms were implemented in the prototype. The set of values were given as input to the prototype and tested with scenarios described under case studies. The results from the prototype are used to analyze the impact caused by various scheduling algorithms on reducing the waiting times of the tests. The combined usage of simulator along with scheduler prototype helped in understanding how to minimize the total time spent for testing and improving the resource allocation process.

Place, publisher, year, edition, pages
2016. , 54 p.
Keyword [en]
function tests, test automation, resource allocation, multiprocessing, parallel testing, scheduling algorithms, evaluation, simulation, prototyping
National Category
Computer Science
URN: urn:nbn:se:liu:diva-131807ISRN: LIU-IDA/LITH-EX-A--16/053--SEOAI: diva2:1033590
External cooperation
Axis Communications AB, Lund
Subject / course
Computer science
2016-09-30, John von Neumann, Hus B, 1 trappa (plan 3), Campus Valla, Linköpings universitet, Linköping, 13:15 (English)
Available from: 2016-10-10 Created: 2016-10-07 Last updated: 2016-10-10Bibliographically approved

Open Access in DiVA

Parallelize Automated Tests in a Build and Test Environment(812 kB)5 downloads
File information
File name FULLTEXT01.pdfFile size 812 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Durairaj, Selva Ganesh
By organisation
Software and Systems
Computer Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 5 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

ReferencesLink to record
Permanent link

Direct link