Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Haptic feedback combined with movement sonification using a friction sound improves task performance in a virtual throwing task
KTH, School of Computer Science and Communication (CSC), Media Technology and Interaction Design, MID. (Sound and Music Computing)ORCID iD: 0000-0002-4422-5223
Uppsala University.
KTH, School of Computer Science and Communication (CSC), Media Technology and Interaction Design, MID. (Sound and Music Computing)ORCID iD: 0000-0002-3086-0322
KTH, School of Computer Science and Communication (CSC), Media Technology and Interaction Design, MID.ORCID iD: 0000-0003-3743-100X
2018 (English)In: Journal on Multimodal User Interfaces, ISSN 1783-7677, E-ISSN 1783-8738Article in journal (Refereed) Published
Abstract [en]

In this paper we present a study on the effects of auditory- and haptic feedback in a virtual throwing task performed with a point-based haptic device. The main research objective was to investigate if and how task performance and perceived intuitiveness is affected when interactive sonification and/or haptic feedback is used to provide real-time feedback about a movement performed in a 3D virtual environment. Emphasis was put on task solving efficiency and subjective accounts of participants’ experiences of the multimodal interaction in different conditions. The experiment used a within-subjects design in which the participants solved the same task in different conditions: visual-only, visuohaptic, audiovisual and audiovisuohaptic. Two different sound models were implemented and compared. Significantly lower error rates were obtained in the audiovisuohaptic condition involving movement sonification based on a physical model of friction, compared to the visual-only condition. Moreover, a significant increase in perceived intuitiveness was observed for most conditions involving haptic and/or auditory feedback, compared to the visual-only condition. The main finding of this study is that multimodal feedback can not only improve perceived intuitiveness of an interface but that certain combinations of haptic feedback and movement sonification can also contribute with performance-enhancing properties. This highlights the importance of carefully designing feedback combinations for interactive applications.

Place, publisher, year, edition, pages
Springer, 2018.
Keywords [en]
Sonification, Haptic feedback, Multimodal interaction, Task performance
National Category
Media Engineering Interaction Technologies Signal Processing
Research subject
Media Technology; Human-computer Interaction; Information and Communication Technology
Identifiers
URN: urn:nbn:se:kth:diva-228229DOI: 10.1007/s12193-018-0264-4Scopus ID: 2-s2.0-85046654956OAI: oai:DiVA.org:kth-228229DiVA, id: diva2:1208781
Projects
MuMi - Multi-agent Multimodal Interaction
Funder
Swedish Research Council, D0511301
Note

QC 20180611

Available from: 2018-05-20 Created: 2018-05-20 Last updated: 2018-06-11Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopushttps://doi.org/10.1007/s12193-018-0264-4

Search in DiVA

By author/editor
Frid, EmmaBresin, RobertoSallnäs Pysander, Eva-Lotta
By organisation
Media Technology and Interaction Design, MID
In the same journal
Journal on Multimodal User Interfaces
Media EngineeringInteraction TechnologiesSignal Processing

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 565 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf