LyricAlly: automatic synchronization of acoustic musical signals and textual lyrics
Proceedings of the 12th annual ACM international conference on Multimedia
Multimodal content-based structure analysis of karaoke music
Proceedings of the 13th annual ACM international conference on Multimedia
Enriching music with synchronized lyrics, images and colored lights
Proceedings of the 1st international conference on Ambient media and systems
Combination of audio and lyrics features for genre classification in digital audio collections
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Word level automatic alignment of music and lyrics using vocal synthesis
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Beat space segmentation and octave scale cepstral feature for sung language recognition in pop music
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
| Hi-index | 0.00 |
We present a framework to synchronize pop music to corresponding text lyric. We refine line level alignment achievable by existing work to syllabic level by using a dynamic programming process. Our main contribution is using music knowledge to constrain the dynamic programming search. This is done by modeling (1) non-uniform note length distribution and (2) a note length distribution for each section type (for example intro, chorus, and bridge). These reduce alignment error by 6.4% and improve time efficiency by a factor of 2.2.