Music similarity-based approach to generating dance motion sequence

Authors:
Minho Lee;Kyogu Lee;Jaeheung Park
Affiliations:
Graduate School of Convergence Science & Technology, Advanced Institutes of Convergence Technology, Seoul National University, Seoul, Republic of Korea;Graduate School of Convergence Science & Technology, Advanced Institutes of Convergence Technology, Seoul National University, Seoul, Republic of Korea;Graduate School of Convergence Science & Technology, Advanced Institutes of Convergence Technology, Seoul National University, Seoul, Republic of Korea
Venue:
Multimedia Tools and Applications
Year:
2013

Citing 9
Cited 0

Visualizing music and audio using self-similarity

MULTIMEDIA '99 Proceedings of the seventh ACM international conference on Multimedia (Part 1)
An Efficient k-Means Clustering Algorithm: Analysis and Implementation

IEEE Transactions on Pattern Analysis and Machine Intelligence
Automated motion synthesis for dancing characters: Motion Capture and Retrieval

Computer Animation and Virtual Worlds - CASA 2005
Synthesis of Dancing Character Motion from Beatboxing Sounds

SG '07 Proceedings of the 8th international symposium on Smart Graphics
Perceptually motivated automatic dance motion generation for music

Computer Animation and Virtual Worlds - CASA' 2009 Special Issue
Music-driven character animation

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Dance Motion Control of a Humanoid Robot Based on Real-Time Tempo Tracking from Musical Audio Signals

ICEC '09 Proceedings of the 8th International Conference on Entertainment Computing
Creating an autonomous dancing robot

Proceedings of the 2009 International Conference on Hybrid Information Technology
MotionLab: a matlab toolbox for extracting and processing experimental motion capture data for neuromuscular simulations

3DPH'09 Proceedings of the 2009 international conference on Modelling the Physiological Human

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a novel approach to generating a sequence of dance motions using music similarity as a criterion to find the appropriate motions given a new musical input. Based on the observation that dance motions used in similar musical pieces can be a good reference in choreographing a new dance, we first construct a music-motion database that comprises a number of segment-wise music-motion pairs. When a new musical input is given, it is divided into short segments and for each segment our system suggests the dance motion candidates by finding from the database the music cluster that is most similar to the input. After a user selects the best motion segment, we perform music-dance synchronization by means of cross-correlation between the two music segments using the novelty functions as an input. We evaluate our system's performance using a user study, and the results show that the dance motion sequence generated by our system achieves significantly higher ratings than the one generated randomly.