Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Properties and Challenges of LLM-Generated Explanations
Linköping University, Department of Computer and Information Science, Artificial Intelligence and Integrated Computer Systems. Linköping University, Faculty of Science & Engineering.
Linköping University, Faculty of Science & Engineering. Linköping University, Department of Computer and Information Science, Artificial Intelligence and Integrated Computer Systems.ORCID iD: 0000-0002-2492-9872
2024 (English)In: Proceedings of the Third Workshop on Bridging Human-Computer Interaction and Natural Language Processing / [ed] Su Lin Blodgett, Amanda Cercas Curry, Sunipa Dey, Michael Madaio, Ani Nenkova, Diyi Yang, Ziang Xiao, ASSOC COMPUTATIONAL LINGUISTICS-ACL , 2024, p. 13-27Conference paper, Published paper (Refereed)
Abstract [en]

The self-rationalising capabilities of large language models (LLMs) have been explored in restricted settings, using task-specific data sets.However, current LLMs do not (only) rely on specifically annotated data; nonetheless, they frequently explain their outputs.The properties of the generated explanations are influenced by the pre-training corpus and by the target data used for instruction fine-tuning.As the pre-training corpus includes a large amount of human-written explanations “in the wild”, we hypothesise that LLMs adopt common properties of human explanations.By analysing the outputs for a multi-domain instruction fine-tuning data set, we find that generated explanations show selectivity and contain illustrative elements, but less frequently are subjective or misleading.We discuss reasons and consequences of the properties’ presence or absence. In particular, we outline positive and negative implications depending on the goals and user groups of the self-rationalising system.

Place, publisher, year, edition, pages
ASSOC COMPUTATIONAL LINGUISTICS-ACL , 2024. p. 13-27
Keywords [en]
Natural Language Processing, Large Language Models, Explainability, Human-AI Interaction
National Category
Natural Language Processing
Identifiers
URN: urn:nbn:se:liu:diva-207112DOI: 10.18653/v1/2024.hcinlp-1.2ISI: 001596065400002ISBN: 9798891761117 (print)OAI: oai:DiVA.org:liu-207112DiVA, id: diva2:1894037
Conference
Third Workshop on Bridging Human-Computer Interaction and Natural Language Processing at NAACL 2024, MEXICO, JUN 21, 2024
Note

Funding Agencies|Wallenberg AI, Autonomous Systems and Software Program (WASP) - Knut and Alice Wallenberg Foundation; European Commission [101135671]

Available from: 2024-09-02 Created: 2024-09-02 Last updated: 2025-12-18

Open Access in DiVA

fulltext(360 kB)307 downloads
File information
File name FULLTEXT02.pdfFile size 360 kBChecksum SHA-512
3af21dcbe484c84225b0d16c7fc779beb3dc0da3cfd47494c89f0dca564df0ef589acd6f457c021be1ce7d6cf45f14f57c70dc1354ae49ae5533daf1534e8144
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Kunz, JennyKuhlmann, Marco
By organisation
Artificial Intelligence and Integrated Computer SystemsFaculty of Science & Engineering
Natural Language Processing

Search outside of DiVA

GoogleGoogle Scholar
Total: 308 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 270 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf