Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Sonification supports perception of brightness contrast
Linköping University, Department of Science and Technology, Media and Information Technology. Linköping University, Faculty of Science & Engineering. (Information Visualization)
2019 (English)In: Journal on Multimodal User Interfaces, ISSN 1783-7677, E-ISSN 1783-8738, Vol. 13, no 13, p. 373-381, article id 4Article in journal (Refereed) Published
Abstract [en]

In complex visual representations, there are several possible challenges for the visual perception that might be eased by adding sound as a second modality (i.e. sonification). It was hypothesized that sonification would support visual perception when facing challenges such as simultaneous brightness contrast or the Mach band phenomena. This hypothesis was investigated with an interactive sonification test, yielding objective measures (accuracy and response time) as well as subjective measures of sonification benefit. In the test, the participant’s task was to mark the vertical pixel line having the highest intensity level. This was done in a condition without sonification and in three conditions where the intensity level was mapped to different musical elements. The results showed that there was a benefit of sonification, with higher accuracy when sonification was used compared to no sonification. This result was also supported by the subjective measurement. The results also showed longer response times when sonification was used. This suggests that the use and processing of the additional information took more time, leading to longer response times but also higher accuracy. There were no differences between the three sonification conditions.

Place, publisher, year, edition, pages
Springer, 2019. Vol. 13, no 13, p. 373-381, article id 4
Keywords [en]
Interactive sonification, Music, Visual perception, Visualization
National Category
Media Engineering
Identifiers
URN: urn:nbn:se:liu:diva-159026DOI: 10.1007/s12193-019-00311-0ISI: 000492417900009OAI: oai:DiVA.org:liu-159026DiVA, id: diva2:1338026
Note

Funding agency:  Linkoping University

Available from: 2019-07-19 Created: 2019-07-19 Last updated: 2019-11-18Bibliographically approved

Open Access in DiVA

fulltext(607 kB)8 downloads
File information
File name FULLTEXT01.pdfFile size 607 kBChecksum SHA-512
d50bc77fc4758bbd8f5737eda6ac1454b8f71ec02aa09816b25d94ab8dca2ce140191d4be6f3cfcb7f72b5e19e5ee01303e4e7b2151ee2c4a2ea1a00eeb16906
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Rönnberg, Niklas
By organisation
Media and Information TechnologyFaculty of Science & Engineering
In the same journal
Journal on Multimodal User Interfaces
Media Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 8 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 19 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf