Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
POTDAI: a tool to evaluate the perceived operational trust degree in artificial intelligence systems
CAILab, Villafranca del Castillo, Universidad Camilo Jose; Cela, Madrid, Spain.ORCID iD: 0000-0003-2422-9005
Faculty of Health Sciences, International University of La Rioja (UNIR), La Rioja, Logroño, Spain.
Umeå University, Faculty of Science and Technology, Department of Computing Science. (Formal Methods for Trustworthy Hybrid Intelligence)ORCID iD: 0000-0003-4072-8795
2024 (English)In: IEEE Access, E-ISSN 2169-3536, Vol. 12, p. 133097-133109Article in journal (Refereed) Published
Abstract [en]

There is evidence that a user’s subjective confidence in an Artificial Intelligence (AI)-based system is crucial in its use, even more decisive than the objective effectiveness and efficiency of the system.Therefore, different methods have been proposed for analyzing confidence in AI. In our research, we set out to evaluate how the degree of perceived trust in an AI system could affect a user’s final decision to follow AI recommendations. To this end, we established trustworthy criteria that such an evaluation should meet by following a co-creation approach with a multidisciplinary group of 10 experts. After a systematic review of3,204 articles, we found that none of the tools met the inclusion criteria. Thus, we introduce the so-called "Perceived Operational Trust Degree in AI” (POTDAI) tool that is based on the findings from the expert group and the literature analysis, with a methodology that adds rigor to that employed previously to create similar evaluation tools. We propose a short questionnaire for quick and easy application, inspired by the original version of the Technology Acceptance Model (TAM) with six Likert-type items. In this way, we also respond to the need pointed out by authors such as Vorm and Combs to extend the TAM to address questions related to user perception in systems with an AI component. Thus, POTDAI can be used alone or in combination with TAM to obtain additional information on its usefulness and ease of use.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024. Vol. 12, p. 133097-133109
Keywords [en]
Artificial intelligence, Cooperative systems, Human-computer interaction, Human factors, Trustworthy AI, Technology Acceptance Model
National Category
Computer Systems
Research subject
Computer Science
Identifiers
URN: urn:nbn:se:umu:diva-229436DOI: 10.1109/access.2024.3454061ISI: 001327303900001Scopus ID: 2-s2.0-85203541352OAI: oai:DiVA.org:umu-229436DiVA, id: diva2:1896025
Funder
EU, Horizon 2020, 952026Available from: 2024-09-09 Created: 2024-09-09 Last updated: 2024-10-28Bibliographically approved

Open Access in DiVA

fulltext(3320 kB)88 downloads
File information
File name FULLTEXT02.pdfFile size 3320 kBChecksum SHA-512
782630f0d8a52cfc026e78cf31f19727b6f5e0164e02d30f4a15187fe053377094566f3a7fc479e80a9213054527b78a8e22a9dc879b53f9c575da3176da7550
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Martín-Moncunill, DavidNieves, Juan Carlos
By organisation
Department of Computing Science
In the same journal
IEEE Access
Computer Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 107 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 241 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf