Music Driven
Choreography Synthesis
F.
Ofli, E. Erzin, Y. Yemez, A.M. Tekalp
- A framework for annotation, modeling, analysis, and synthesis of multi-modal dance performances:
- Analyze correlations between music featuresand dance figure labels,
- Construct a mapping from musicmeasures(segments) to dancefigures,
- which is many-to-many
- Synthesize music-driven dance choreography,
- Generate a personalized dance performance animation.
Synthesis-by-Analysis
Block Diagram

Demo:
Publications:
- Ferda Ofli. Learning Statistical Music-to-Dance Mappings for Choreography Synthesis. PhD thesis, Koc University, 2010.
- F. Ofli, E. Erzin, Y. Yemez, A.M. Tekalp, "Learn2Dance: Learning Statistical Music-to-Dance Mappings for Choreography Synthesis," submitted to IEEE Transactions on Multimedia.
- F. Ofli, Y. Demir, Y. Yemez, E. Erzin, A.M. Tekalp, K. Balci, I. Kizoglu, L. Akarun, C. Canton-Ferrer, J. Tilmanne, ve E. Bozkurt, ``An audio-driven dancing avatar,'' Journal on Multimodal User Interfaces, vol. 2, no. 2, pp. 93-103, September 2008.
- F. Ofli, E. Erzin, Y. Yemez, A.M. Tekalp, "Multi-modal analysis of dance performances for music-driven choreography synthesis," ICASSP'10 Dallas, USA.
- F. Ofli, E. Erzin, Y. Yemez, A. M. Tekalp, A. T. Erdem, C. Erdem, T. Abaci, M. Ozkan "Unsupervised Dance Figure Analysis from Video for Dancing Avatar Animation," ICIP'08 San Diego, USA.
- Y. Demir, E. Erzin, Y. Yemez, and A. M. Tekalp, ”Evaluation of Audio Features for Audio-Visual Analysis of Dance Figures,” EUSIPCO'08, Lausanne, Switzerland.
- F. Ofli, C. Canton-Ferrer, J. Tilmanne, Y. Demir, E. Bozkurt, Y. Yemez, E. Erzin, A.M. Tekalp, "Audio-driven human body motion analysis and synthesis," ICASSP'08 Las Vegas, USA.
- E. Erzin, Y. Yemez, A.M. Tekalp, "COST ACTION 2102: Cross Modal Analysis of Verbal and Nonverbal Communication," funded by TUBITAK & COST, 2008-2010.
- A. M. Tekalp, E. Erzin, Y. Yemez, ``SIMILAR: The European taskforce creating human-machine interfaces SIMILAR to human-human communication,'' FP6 Network of Excellence, 2003-2007.
