Change search
ReferencesLink to record
Permanent link

Direct link
The focus on usability in testing practices in industry
Reykjavik University.
Calidris Ltd.
KTH, School of Computer Science and Communication (CSC), Human - Computer Interaction, MDI (closed 20111231).ORCID iD: 0000-0002-2411-6417
2010 (English)Conference paper (Refereed)
Place, publisher, year, edition, pages
Keyword [en]
usability, software testing, agile development, Scrum, practitioners
National Category
Human Computer Interaction
URN: urn:nbn:se:kth:diva-95300ScopusID: 2-s2.0-84943635442OAI: diva2:527505
Human-Computer Interaction Symposium at the World Computer Congress, Brisbane, Australia.

QC 20120521

Available from: 2012-05-21 Created: 2012-05-21 Last updated: 2016-03-14Bibliographically approved
In thesis
1. User Centred Evaluation in Experimental and Practical Settings
Open this publication in new window or tab >>User Centred Evaluation in Experimental and Practical Settings
2012 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The objective of this thesis is to obtain knowledge regarding how effective user centred evaluation methods are and how user centred evaluations are conducted by IT professionals. This will be achieved by exploring user centred evaluation in experimental and practical settings. The knowledge gained in these studies should inspire suggestions for further research and suggestions for improvements on the user centred evaluation activity.

Two experimental studies were conducted. One compares the results from using three user centred evaluation methods, and the other examines two factors while conducting heuristic evaluation. The results show that the think-aloud evaluation method was the most effective method in finding realistic usability problems of the three methods. The number of critical problems found during think-aloud evaluation increases, if heuristic evaluation is conducted prior to the think-aloud evaluations.

Further, two studies of user centred evaluation in practical settings were performed. The IT professionals participating in those studies were using the software development process Scrum to plan their work. The results show that user centred evaluation is infrequently conducted in Scrum projects, compared to testing activities like acceptance testing. The main type of evaluation is qualitative. Few participants measure user performance or use surveys to gather quantitative results on the usability and the user experience. IT professionals get feedback from users in an informal way and gather informal feedback from peers. Many participants use a mixture of methods for gathering feedback on their work.

The outcome of this thesis shows that IT professionals should be encouraged to include users whenever possible when evaluating software, for example by using the think-aloud method. Using heuristic evaluation prior to conducting think-aloud evaluations is also recommended. In addition, IT professionals are encouraged to evaluate their software in an informal way frequently, rather than waiting for the right time to conduct a thorough quantitative evaluation.

To advance this field further, researchers who want to improve the evaluation activity for the IT professionals should study how user centred evaluation methods could be combined in an efficient way and how the use of qualitative evaluation methods could be made more effective.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2012. xii, 80 p.
Trita-CSC-A, ISSN 1653-5723 ; 2012:05
User centred evaluation, Scrum, evaluation methods, agile software development
National Category
Human Computer Interaction
urn:nbn:se:kth:diva-95302 (URN)978-91-7501-357-2 (ISBN)
Public defence
2012-06-08, F3, Lindstedtsvagen 26, KTH, Stockholm, 13:15 (English)
QC 20120522Available from: 2012-05-22 Created: 2012-05-21 Last updated: 2012-05-22Bibliographically approved

Open Access in DiVA

Paper 3 - Marta L(59 kB)473 downloads
File information
File name FULLTEXT01.pdfFile size 59 kBChecksum SHA-512
Type fulltextMimetype application/pdf


Search in DiVA

By author/editor
Larusdottir, Marta K.Gulliksen, Jan
By organisation
Human - Computer Interaction, MDI (closed 20111231)
Human Computer Interaction

Search outside of DiVA

GoogleGoogle Scholar
Total: 473 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 64 hits
ReferencesLink to record
Permanent link

Direct link