Statistical modeling of bowing control applied to violin sound synthesis

  • Authors:
  • Esteban Maestre;Merlijn Blaauw;Jordi Bonada;Enric Guaus;Alfonso Pérez

  • Affiliations:
  • Music Technology Group, Universitat Pompeu Fabra, Barcelona, Spain;Music Technology Group, Universitat Pompeu Fabra, Barcelona, Spain;Music Technology Group, Universitat Pompeu Fabra, Barcelona, Spain;Music Technology Group, Universitat Pompeu Fabra, Barcelona, Spain;Music Technology Group, Universitat Pompeu Fabra, Barcelona, Spain

  • Venue:
  • IEEE Transactions on Audio, Speech, and Language Processing - Special issue on virtual analog audio Effects and musical instruments
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Excitation-continuous music instrument control patterns are often not explicitly represented in current sound synthesis techniques when applied to automatic performance. Both physical model-based and sample-based synthesis paradigms would benefit from a flexible and accurate instrument control model, enabling the improvement of naturalness and realism. We present a framework for modeling bowing control parameters in violin performance. Nearly non-intrusive sensing techniques allow for accurate acquisition of relevant timbre-related bowing control parameter signals. We model the temporal contour of bow velocity, bow pressing force, and bow-bridge distance as sequences of short Bézier cubic curve segments. Considering different articulations, dynamics, and performance contexts, a number of note classes are defined. Contours of bowing parameters in a performance database are analyzed at note-level by following a predefined grammar that dictates characteristics of curve segment sequences for each of the classes in consideration. As a result, contour analysis of bowing parameters of each note yields an optimal representation vector that is sufficient for reconstructing original contours with significant fidelity. From the resulting representation vectors, we construct a statistical model based on Gaussian mixtures suitable for both the analysis and synthesis of bowing parameter contours. By using the estimated models, synthetic contours can be generated through a bow planning algorithm able to reproduce possible constraints caused by the finite length of the bow. Rendered contours are successfully used in two preliminary synthesis frameworks: digital waveguide-based bowed string physical modeling and sample-based spectral-domain synthesis.