Change search
ReferencesLink to record
Permanent link

Direct link
Automated GUI regression tests via remote desktop with Robot Framework and Sikuli
Mid Sweden University, Faculty of Science, Technology and Media, Department of Information and Communication systems.
2014 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

To test software over a remote desktop is an increasingly common practice since outsourcing and offshoring of testing activities are on the rise. Most companies useproprietary testing tools which require an agent to be installed on the remote machine.This installation opens several attack surfaces and has thus the potential to compromise security. In addition license, support and other proprietary test tool costs might reduce the return on investment of automated tests to an unprofitable level, especially for relatively short projects.Robot Framework with Sikuli integration (RFSI) is a concept based on two open source tools which offer solutions concerning the security and cost issues. RFSI based tests do not need any further installations, access rights or network configurations on the remote machine, because of the fact that the tests are based on visual input. Therefore tests with RFSI cannot access the AUT (Application Under Test) or the remote machine in any other way than a manual tester could. Open-source tools, being freely available, also escape the problem of licence costs. The purpose of the proof of concept pilot study wasto give an answer on the question if RFSI can furthermore be considered an alternative to proprietary tools in terms of requirements for tool quality characteristics and for the external context of test automation projects.The methodology of this research followed the broader Goal-Question-Metrics method(GQM) described by Rini van Solingen and Egon Berghout, based on the GQM approachby Victor Basili and David Weiss. The requirements and metrics for the evaluation of RFSI in the study were selected through a literature study of ISO/IEC-TR9126-3 and other articles in the field. They comprehend six categories: functionality, reliability,maintainability and stability, efficiency, understandability and portability. For each category,metrics were established and adapted to the context of the proof of concept. The scope of the project was given by six use cases and test specifications, established in cooperation with system experts at the company CGI Sundsvall. These were then translated into RFSI test scripts and implemented with the requirements for successful remote GUI testing in mind.The results of the measurements for the proof of concept study showed that RFSI fulfilles the internal and external requirements for successful automated testing completely for functionality, understandability and portability. The requirements are partially satisfiedfor reliability, maintainability and stability, and efficiency.In conclusion, RFSI satisfies enough requirements to be considered a viable alternative to commercial testing tools for tests of GUI (Graphical User Interface) desktop applications over a remote desktop.

Place, publisher, year, edition, pages
Keyword [en]
automated tests, Robot Framework, Sikuli
National Category
Other Computer and Information Science
URN: urn:nbn:se:miun:diva-24473OAI: diva2:791496
Subject / course
Industrial Organization and Economy IE1
Educational program
Master of Science in Industrial Engineering and Management TINDA 300 higher education credits
2014-06-03, 12:56 (English)
Available from: 2015-03-06 Created: 2015-02-28 Last updated: 2015-03-06Bibliographically approved

Open Access in DiVA

fulltext(3411 kB)166 downloads
File information
File name FULLTEXT01.pdfFile size 3411 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Ludovici, Michelle
By organisation
Department of Information and Communication systems
Other Computer and Information Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 166 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 349 hits
ReferencesLink to record
Permanent link

Direct link