Potential relevance of audio-visual integration in mammals for computational modelling
2006 (English)In: Proceedings of the 9th International Conference on Spoken Language Processing, Interspeech 2006 (ICSLP), Pittsburgh, September, 2006., 2006Conference paper (Refereed)
infants’ integration of audio-visual sensory information as a fundamental process involved in early word learning. One hundred sixty pre-linguistic children were randomly assigned to watch one of four counterbalanced versions of audio-visual video sequences. The infants’ eye-movements were recorded and their looking behavior was analyzed throughout three repetitions of exposure-test-phases. The results indicate that the infants were able to learn covariance between shapes and colors of arbitrary geometrical objects and to them corresponding nonsense words. Implications of audio-visual integration in infants and in non-human animals for modeling within speech recognition systems, neural networks and robotics are discussed.
Place, publisher, year, edition, pages
Research subject Phonetics
IdentifiersURN: urn:nbn:se:su:diva-62513OAI: oai:DiVA.org:su-62513DiVA: diva2:442467
ProjectsModeling interactive Language Learning
FunderRiksbankens Jubileumsfond, K2003-0867Swedish Research Council, 421-2001-4876