Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Impediments for Automated Testing - An Empirical Analysis of a User Support Discussion Board
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems. (IS (Embedded Systems))ORCID iD: 0000-0001-8228-813X
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems. (IS (Embedded Systems))ORCID iD: 0000-0002-5032-2310
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems. Ericsson AB, Sweden. (IS (Embedded Systems))ORCID iD: 0000-0002-5070-9312
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems. (IS (Embedded Systems))ORCID iD: 0000-0003-0904-3712
2014 (English)In: Seventh IEEE International Conference on Software Testing, Verification and Validation ICST 2014, IEEE , 2014, 113-122 p.Conference paper, Published paper (Refereed)
Abstract [en]

To better understand the challenges encountered by users and developers of automatic software testing, we have performed an empirical investigation of a discussion board used for support of a test automation framework having several hundred users. The messages on the discussion board were stratified into problem reports, help requests, development information, and feature requests. The messages in the problem report and help request strata were then sampled and analyzed using thematic analysis, searching for common patterns. Our analysis indicate that a large part of the impediments discussed on the board are related to issues related to the centralized IT environment, and to erroneous behavior connected to the use of the framework and related components. We also observed a large amount of impediments related to the use of software development tools. Turning to the help requests, we found that the majority of the help requests were about designing test scripts and not about the areas that appear to be most problematic. From our results and previous publications, we see a clear need to simplify the use, installation, and configuration of test systems of this type. The problems attributable to software development tools suggest that testers implementing test automation need more skills in handling those tools, than historically has been assumed. Finally, we propose that further research into the benefits of centralization of tools and IT environments, as well as structured deployment and efficient use of test automation, is performed.

Place, publisher, year, edition, pages
IEEE , 2014. 113-122 p.
Keyword [en]
software testing, test automation, test tools, empirical software engineering
National Category
Engineering and Technology
Identifiers
URN: urn:nbn:se:mdh:diva-25144DOI: 10.1109/ICST.2014.24ISI: 000355985000014Scopus ID: 2-s2.0-84903195625ISBN: 978-0-7695-5185-2 (print)OAI: oai:DiVA.org:mdh-25144DiVA: diva2:722779
Conference
Seventh IEEE International Conference on Software Testing, Verification and Validation ICST 2014, March 31-April 4 2014, Cleveland, United States
Available from: 2014-06-09 Created: 2014-06-05 Last updated: 2015-07-16Bibliographically approved

Open Access in DiVA

No full text

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Wiklund, KristianSundmark, DanielEldh, SigridLundqvist, Kristina
By organisation
Embedded Systems
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar

Altmetric score

Total: 41 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf