A framework for music analysis instruction system with synchronization of MIDI and real performaing audio

  • Authors:

  • Hao-Tung Lin;Yu-Yuan Lin;Ting-Yi Ma;Herng-Yow Chen

  • Affiliations:

  • Department of Computer Science and Information Engineering, National Chi-Nan University, Pu-Li, Nan-Tou County, Taiwan;Department of Computer Science and Information Engineering, National Chi-Nan University, Pu-Li, Nan-Tou County, Taiwan;Department of Music, National Pingtung University of Education, Pingtung, Taiwan;Department of Computer Science and Information Engineering, National Chi-Nan University, Pu-Li, Nan-Tou County, Taiwan

  • Venue:
  • WBED'07 Proceedings of the sixth conference on IASTED International Conference Web-Based Education - Volume 2
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

For college students who major in Music, listening to audio recordings with analytical instructions and music scores is an important task. In this paper we proposes a Web-based music lecture authoring, annotating, and presentation framework, which is especially designed for Music instructors to easily record their lecturing comments (i.e., voice and tele-pointer) based on some prepared teaching materials (i.e., music score, audio or MIDI, and analysis figure for music), so as for students to replay the multimedia lecture after class on the Web. To present the music score and waveform audio in a synchronized manner, we design a MIDI-to-WAV alignment algorithm that can explore the temporal relations between MIDI and the corresponding performance recording. We built a system prototype to demonstrate the feasibility and effectiveness of our idea.