Change search
ReferencesLink to record
Permanent link

Direct link
Feedback in multimodal self-organizing networks enhances perception of corrupted stimuli
LuleƄ University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Internet Systems Lab.
2006 (English)In: AI 2006: Advances in Artificial Intelligence. 19th Australian Joint Conference on Artificial Intelligence, Hobart, Australia, December 4-8, 2006. Proceedings / [ed] Abdul Sattar; Byeong-Ho Kang, Encyclopedia of Global Archaeology/Springer Verlag, 2006, 19-28 p.Conference paper (Refereed)
Abstract [en]

It is known from psychology and neuroscience that multimodal integration of sensory information enhances the perception of stimuli that are corrupted in one or more modalities. A prominent example of this is that auditory perception of speech is enhanced when speech is bimodal, i.e. when it also has a visual modality. The function of the cortical network processing speech in auditory and visual cortices and in multimodal association areas, is modeled with a Multimodal Self-Organizing Network (MuSON), consisting of several Kohonen Self-Organizing Maps (SOM) with both feedforward and feedback connections. Simulations with heavily corrupted phonemes and uncorrupted letters as inputs to the MuSON demonstrate a strongly enhanced auditory perception. This is explained by feedback from the bimodal area into the auditory stream, as in cortical processing.

Place, publisher, year, edition, pages
Encyclopedia of Global Archaeology/Springer Verlag, 2006. 19-28 p.
Lecture Notes in Computer Science, ISSN 0302-9743 ; 4304
Research subject
Industrial Electronics
URN: urn:nbn:se:ltu:diva-31745DOI: 10.1007/11941439_6Local ID: 601f6b00-960b-11db-8975-000ea68e967bISBN: 3-540-49787-0OAI: diva2:1004979
Australian Joint Conference on Artificial Intelligence : 04/12/2006 - 08/12/2006
Validerad; 2006; Bibliografisk uppgift: Lecture Notes in Artificial Intelligence; 20061228 (ysko)Available from: 2016-09-30 Created: 2016-09-30Bibliographically approved

Open Access in DiVA

fulltext(177 kB)0 downloads
File information
File name FULLTEXT01.pdfFile size 177 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Gustafsson, LennartPaplinski, Andrew
By organisation
Embedded Internet Systems Lab

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

ReferencesLink to record
Permanent link

Direct link