A recurrent multimodal network for binding written words and sensory-based semantics into concepts
2011 (English)In: Neural Information Processing: 18th International Conference, ICONIP 2011, Shanghai, China, November 13-17, 2011, Proceedings / [ed] Bao-Liang Lu; Liqing Zhang; James Kwok, Berlin: Springer Science+Business Media B.V., 2011, Vol. 1, 413-422 p.Conference paper (Refereed)
We present a recurrent multimodal model of binding written words to mental objects and investigate the capability of the network in reading misspelt but categorically related words. Our model consists of three mutually interconnected association modules which store mental objects, represent their written names and bind these together to form mental concepts. A feedback gain controlling top-down influence is incorporated into the model architecture and it is shown that correct settings for this during map formation and simulated reading experiments is necessary for correct interpretation and semantic binding of the written words.
Place, publisher, year, edition, pages
Berlin: Springer Science+Business Media B.V., 2011. Vol. 1, 413-422 p.
Lecture Notes in Computer Science, ISSN 0302-9743 ; 7062
Research subject Industrial Electronics
IdentifiersURN: urn:nbn:se:ltu:diva-33177DOI: 10.1007/978-3-642-24955-6_50ScopusID: 81855226561Local ID: 7f9bd680-9a12-4053-9e84-ef1a0cd9d4d9OAI: oai:DiVA.org:ltu-33177DiVA: diva2:1006413
International Conference on Neural Information Processing : 13/11/2011 - 17/11/2011
Validerad; 2011; 20111116 (ysko)2016-09-302016-09-30Bibliographically approved