Change search
ReferencesLink to record
Permanent link

Direct link
Revisiting Heuristic Evaluation Methods to Improve the Reliability of Findings
Blekinge Institute of Technology, Faculty of Computing, Department of Creative Technologies.ORCID iD: 0000-0002-9854-7690
2014 (English)Conference paper (Refereed) PublishedAlternative title
Omprövning av Heuristiska utvärderingsmetoder i syfte att förbättra dess reliabilitet (Swedish)
Abstract [en]

The heuristic evaluation (HE) method is one of the most common in the suite of tools for usability evaluations because it is a fast, inexpensive and resource-efficient process in relation to the many usability issues it generates. The method emphasizes completely independent initial expert evaluations. Inter-rater reliability and agreement coefficients are not calculated. The variability across evaluators, even dual domain experts, can be significant as is seen in the case study here. The implications of this wide variability mean that results are unique to each HE, results are not readily reproducible and HE research on usability is not yet creating a uniform body of knowledge. We offer recommendations to improve the science by incorporating selected techniques from qualitative research: calculating inter-rater reliability and agreement scores, creating a codebook to define concepts/categories and offering crucial information about raters' backgrounds, agreement techniques and the evaluation setting.

Place, publisher, year, edition, pages
Istanbul: IOS Press , 2014.
Keyword [en]
Heuristic Evaluation, eHealth, mHealth, Usability Research Methods
National Category
Human Aspects of ICT Medical Laboratory and Measurements Technologies
URN: urn:nbn:se:bth-6616DOI: 10.3233/978-1-61499-432-9-930Local ID: 978-1-61499-432-9OAI: diva2:834138
Studies in Health Technology and Informatics, IOS Press, indexed in Medline (PubMed)Available from: 2014-09-24 Created: 2014-09-22 Last updated: 2016-10-11Bibliographically approved

Open Access in DiVA

fulltext(249 kB)76 downloads
File information
File name FULLTEXT01.pdfFile size 249 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Georgsson, Mattias
By organisation
Department of Creative Technologies
Human Aspects of ICTMedical Laboratory and Measurements Technologies

Search outside of DiVA

GoogleGoogle Scholar
Total: 76 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

Total: 263 hits
ReferencesLink to record
Permanent link

Direct link