A system for facial expression-based affective speech translation
2013 (English)In: Proceedings of the companion publication of the 2013 international conference on Intelligent user interfaces companion, 2013, 57-58 p.Conference paper (Refereed)Text
In the emerging eld of speech-to-speech translation, empha- sis is currently placed on the linguistic content, while the sig- ni cance of paralinguistic information conveyed by facial ex- pression or tone of voice is typically neglected. We present a prototype system for multimodal speech-to-speech transla- tion that is able to automatically recognize and translate spo- ken utterances from one language into another, with the out- put rendered by a speech synthesis system. The novelty of our system lies in the technique of generating the synthetic speech output in one of several expressive styles that is au- tomatically determined using a camera to analyze the user’s facial expression during speech.
Place, publisher, year, edition, pages
2013. 57-58 p.
Other Engineering and Technologies
IdentifiersURN: urn:nbn:se:kth:diva-185528OAI: oai:DiVA.org:kth-185528DiVA: diva2:922174
International conference on intelligent user interfaces,IUI'13 Companion, March 19–22, 2013, Santa Monica, CA, USA