Ändra sökning
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
How Was Your Day?: Evaluating a Conversational Companion
Stockholms universitet, Samhällsvetenskapliga fakulteten, Institutionen för data- och systemvetenskap.
Visa övriga samt affilieringar
2013 (Engelska)Ingår i: IEEE Transactions on Affective Computing, ISSN 1949-3045, Vol. 4, nr 3, 299-311 s.Artikel i tidskrift (Refereegranskat) Published
Abstract [en]

The How Was Your Day(HWYD) companion is an embodied conversational agent that can discuss work-related issues, entering free-form dialogues while discussing issues surrounding a typical work day. The open-ended nature of these interactions requires new models of evaluation. Here, we describe a paradigm and methodology for evaluating the main aspects of such functionality in conjunction with overall system behavior, with respect to three parameters: functional ability (i.e., does it do the rightthing conversationally), content (i.e., does it respond appropriately to the semantic context), and emotional behavior (i.e., given the emotional input from the user, does it respond in an emotionally appropriate way). We demonstrate the functionality of our evaluation paradigm as a method for both grading current system performance, and targeting areas for particular performance review. We show correlation between, for example, automatic speech recognition performance and overall system performance (as is expected in systems of this type), but beyond this, we show where individual utterances or responses, indicated as positive or negative, characterize system performance, and demonstrate how our combination evaluation approach highlights issues (both positive and negative) in the companion system's interaction behavior.

Ort, förlag, år, upplaga, sidor
2013. Vol. 4, nr 3, 299-311 s.
Nyckelord [en]
Companions, embodied conversational agents, evaluation, appropriateness of dialogue
Nationell ämneskategori
Systemvetenskap, informationssystem och informatik
Identifikatorer
URN: urn:nbn:se:su:diva-97674ISI: 000327144400006OAI: oai:DiVA.org:su-97674DiVA: diva2:679848
Anmärkning

AuthorCount:5;

Tillgänglig från: 2013-12-16 Skapad: 2013-12-16 Senast uppdaterad: 2014-02-10Bibliografiskt granskad

Open Access i DiVA

Fulltext saknas

Sök vidare i DiVA

Av författaren/redaktören
Hansen, Preben
Av organisationen
Institutionen för data- och systemvetenskap
Systemvetenskap, informationssystem och informatik

Sök vidare utanför DiVA

GoogleGoogle Scholar

Totalt: 28 träffar
RefereraExporteraLänk till posten
Permanent länk

Direktlänk
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annat format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annat språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf