Generating Structured Test Data with Specific Properties using Nested Monte-Carlo Search
2014 (English)In: GECCO'14: PROCEEDINGS OF THE 2014 GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, Association for Computing Machinery (ACM), 2014, 1279-1286 p.Conference paper (Refereed)
Software acting on complex data structures can be challenging to test: it is difficult to generate diverse test data that satisfies structural constraints while simultaneously exhibiting properties, such as a particular size, that the test engineer believes will be effective in detecting faults. In our previous work we introduced GödelTest, a framework for generating such data structures using non-deterministic programs, and combined it with Differential Evolution to optimize the generation process. Monte-Carlo Tree Search (MCTS) is a search technique that has shown great success in playing games that can be represented as sequence of decisions. In this paper we apply Nested Monte-Carlo Search, a single-player variant of MCTS, to the sequence of decisions made by the generating programs used by GödelTest, and show that this combination can efficiently generate random data structures which exhibit the specific properties that the test engineer requires. We compare the results to Boltzmann sampling, an analytical approach to generating random combinatorial data structures.
Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2014. 1279-1286 p.
Search-based software testing, Automated testing
Software Engineering Computer Science
IdentifiersURN: urn:nbn:se:bth-6526DOI: 10.1145/2576768.2598339ISI: 000364333000160ISBN: 978-1-4503-2662-9OAI: oai:DiVA.org:bth-6526DiVA: diva2:834044
16th Genetic and Evolutionary Computation Conference (GECCO), Vancouver