Feedback in multimodal self-organizing networks enhances perception of corrupted stimuli
2006 (English)In: AI 2006: Advances in Artificial Intelligence. 19th Australian Joint Conference on Artificial Intelligence, Hobart, Australia, December 4-8, 2006. Proceedings / [ed] Abdul Sattar; Byeong-Ho Kang, Encyclopedia of Global Archaeology/Springer Verlag, 2006, 19-28 p.Conference paper (Refereed)
It is known from psychology and neuroscience that multimodal integration of sensory information enhances the perception of stimuli that are corrupted in one or more modalities. A prominent example of this is that auditory perception of speech is enhanced when speech is bimodal, i.e. when it also has a visual modality. The function of the cortical network processing speech in auditory and visual cortices and in multimodal association areas, is modeled with a Multimodal Self-Organizing Network (MuSON), consisting of several Kohonen Self-Organizing Maps (SOM) with both feedforward and feedback connections. Simulations with heavily corrupted phonemes and uncorrupted letters as inputs to the MuSON demonstrate a strongly enhanced auditory perception. This is explained by feedback from the bimodal area into the auditory stream, as in cortical processing.
Place, publisher, year, edition, pages
Encyclopedia of Global Archaeology/Springer Verlag, 2006. 19-28 p.
Lecture Notes in Computer Science, ISSN 0302-9743 ; 4304
Research subject Industrial Electronics
IdentifiersURN: urn:nbn:se:ltu:diva-31745DOI: 10.1007/11941439_6Local ID: 601f6b00-960b-11db-8975-000ea68e967bISBN: 3-540-49787-0OAI: oai:DiVA.org:ltu-31745DiVA: diva2:1004979
Australian Joint Conference on Artificial Intelligence : 04/12/2006 - 08/12/2006
Validerad; 2006; Bibliografisk uppgift: Lecture Notes in Artificial Intelligence; 20061228 (ysko)2016-09-302016-09-30Bibliographically approved