Change search
CiteExportLink to record
Permanent link

Direct link
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Health Information Systems Evaluation
2015 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]


Health information systems have emerged as a major component in our response to the trends of rising demands in health care. The insight being gained from the evaluation of those systems can critically influence the shaping of the response. Summative or formative evaluation of health information systems assesses their quality, acceptance, and usefulness, creates insight for improvement, discriminates between options, and refines future development strategies. But the evaluation of health information systems can be challenging due to the propagation of their impacts through multiple socio-technological layers till the ultimate recipients, their heterogeneity and fast evolvement, and the complexity of health care settings and systems.


This thesis tries to explain the challenges of evaluation of health information systems with a narrow down on determining evaluation aspects and to propose relevant solutions. The thesis goes for solutions that mitigate heterogeneity and incomparability, recruit or extend available evaluation models, embrace a wide context of application, and promote automation.


The literature on health information systems evaluation, methods of dealing with heterogeneity in other disciplines of information systems, and ontology engineering were surveyed. Based on the literature survey, the UVON method, based on ontology engineering, was first developed in study 1. The method was applied in FI-STAR, a European Union project in e-Health with 7 use-cases, for summative evaluation of the individual and whole e-health applications. Study 2, extended the UVON method for a formative evaluation during the design phase.


Application of the UVON method resulted in evaluation aspects that were delivered to the seven use-cases of the FI-STAR project in the form of questionnaires. The resulted evaluation aspects were considered sensible and with a confirming overlap with another highly used method in this field (MAST). No significant negative feedback from the FI-STAR use-case owners (n=7) or the respondents (n=87 patients and n=30 health professionals) was received or observed.


In the evaluation of health information systems --possibly also in other similarly characterized systems-- ontology engineering methods, such as the proposed UVON method, can be applied to create a flexible degree of unification across a heterogeneous set of evaluation aspects, import evaluation aspects from other evaluation methods, and prioritize between quality aspects in design phase. Ontologies, through their semantic network structures, can capture the extracted knowledge required for evaluation, facilitate computation of that knowledge, promote automation of evaluation, and accommodate further extensions of the related evaluation methods by adding new features to their network structure.


Place, publisher, year, edition, pages
Karlskrona: Blekinge Tekniska Högskola, 2015.
Blekinge Institute of Technology Licentiate Dissertation Series, ISSN 1650-2140 ; 7
National Category
Other Health Sciences
URN: urn:nbn:se:bth-10910ISBN: 978-91-7295-315-4 (print)OAI: diva2:866706
2015-12-02, G340, Campus Gräsvik, Karlskrona, 13:15 (English)
Available from: 2015-11-03 Created: 2015-11-03 Last updated: 2015-11-30Bibliographically approved

Open Access in DiVA

fulltext(7453 kB)