Speech Driven Upper Body Animation

• Building a framework for joint analysis of
• facial expressions,
• body gestures and
• speech
• To generate an expressive audio-visual mapping from speech to face and body animation.
• Speech
• the source of emotional mood and context
• Face animation
• animation of lips and facial expressions
• Body animation
• upper body animation including hands, arms, shoulders, chest, and head movements

1. E. Bozkurt, C. Eroglu Erdem, T. Erdem and E. Erzin "Formant Position based Weighted Spectral Features for Emotion Recognition," accepted to Speech Communication.
2. M.E. Sargın, Y. Yemez, E. Erzin, and A.M. Tekalp, "Analysis of Head Gesture and Prosody Patterns for Prosody-Driven Head-Gesture Animation," IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 30, Issue 8, pp. 1330 - 1345, Agust 2008.
3. E. Bozkurt, E. Erzin, C. Eroglu Erdem and T. Erdem, "Use of Line Spectral Frequencies for Emotion Recognition from Speech," ICPR'2010, Istanbul, Turkey.
4. C. Eroglu Erdem, E. Bozkurt, E. Erzin  and T. Erdem, "RANSAC-based Training Data Selection for Emotion Recognition from Spontenous Speech," AFFINE'10, Frienze, Italy.
5. E. Bozkurt, E. Erzin, C. Eroglu Erdem and T. Erdem, "Improving Automatic Emotion Recognition from Speech Signals," INTERSPEECH 2009 Emotion Challenge, Sept. 2009.
6. E. Bozkurt, C. Eroglu Erdem, E. Erzin, T. Erdem, M. Ozkan and A.M. Tekalp, "Speech-Driven Automatic Facial Expression Synthesis," 3DTV Conference, Istanbul, 28-30 May 2008.
7. M. E. Sargin, E. Erzin, Y. Yemez, A. M. Tekalp, A. T. Erdem, C. Erdem, M. Ozkan "Prosody-Driven Head-Gesture Animation," ICASSP'07.
8. M.E. Sargin, O. Aran, A. Karpov,F. Ofli, Y. Yasinnik, S. Wilson, E. Erzin, Y. Yemez and A.M. Tekalp " Combined Gesture-Speech Analysis and Speech Driven Gesture Synthesis," IEEE Int. Conf. on Multimedia Expo, Toronto, 2006.

• E. Erzin, Y. Yemez, A.M. Tekalp, "Speech Driven Upper Body Animation," funded by Turk Telekom, 2010-2012.

TOP