Recognition and prediction in a network music performance system for Indian percussion

  • Authors:
  • Mihir Sarkar;Barry Vercoe

  • Affiliations:
  • Massachusetts Institute of Technology, Cambridge, Massachusetts;Massachusetts Institute of Technology, Cambridge, Massachusetts

  • Venue:
  • NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Playing music over the Internet, whether for real-time jamming, network performance or distance education, is constrained by the speed of light which introduces, over long distances, time delays unsuitable for musical applications. Current musical collaboration systems generally transmit compressed audio streams over low-latency and high-bandwidth networks to optimize musician synchronization. This paper proposes an alternative approach based on pattern recognition and music prediction. Trained for a particular type of music, here the Indian tabla drum, the system called TablaNet identifies rhythmic patterns by recognizing individual strokes played by a musician and mapping them dynamically to known musical constructs. Symbols representing these musical structures are sent over the network to a corresponding computer system. The computer at the receiving end anticipates incoming events by analyzing previous phrases and synthesizes an estimated audio output. Although such a system may introduce variants due to prediction approximations, resulting in a slightly different musical experience at both ends, we find that it demonstrates a high level of playability with an immediacy not present in other systems, and functions well as an educational tool.