Change search
ReferencesLink to record
Permanent link

Direct link
Bimodal integration of phonemes and letters: an application of multimodal self-organizing networks
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Embedded Internet Systems Lab.
2006 (English)In: International Joint Conference on Neural Networks: IJCNN '06, Piscataway, NJ: IEEE Communications Society, 2006, 312-318 p.Conference paper (Refereed)
Abstract [en]

Multimodal integration of sensory information has clear advantages for survival: events that can be sensed in more than one modality are detected more quickly and accurately, and if the sensory information is corrupted by noise the classification of the event is more robust in multimodal percepts than in the unisensory information. It is shown that using a Multimodal Self-Organizing Network (MuSON), consisting of several interconnected Kohonen Self-Organizing Maps (SOM), bimodal integration of phonemes, auditory elements of language, and letters, visual elements of language, can be simulated. Robustness of the bimodal percepts against noise in both the auditory and visual modalities is clearly demonstrated.

Place, publisher, year, edition, pages
Piscataway, NJ: IEEE Communications Society, 2006. 312-318 p.
Research subject
Industrial Electronics
URN: urn:nbn:se:ltu:diva-34134DOI: 10.1109/IJCNN.2006.246697Local ID: 84039b50-965f-11db-8975-000ea68e967bISBN: 0-7803-9490-9OAI: diva2:1007384
IEEE World Congress on Computational Intelligence : 16/07/2006 - 21/07/2006
Godkänd; 2006; 20061228 (ysko)Available from: 2016-09-30 Created: 2016-09-30Bibliographically approved

Open Access in DiVA

fulltext(200 kB)0 downloads
File information
File name FULLTEXT01.pdfFile size 200 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Search in DiVA

By author/editor
Gustafsson, LennartPaplinski, Andrew
By organisation
Embedded Internet Systems Lab

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Altmetric score

ReferencesLink to record
Permanent link

Direct link