Sound-by-numbers: motion-driven sound synthesis

  • Authors:
  • M. Cardle;S. Brooks;Z. Bar-Joseph;P. Robinson

  • Affiliations:
  • University of Cambridge;University of Cambridge;MIT Lab for Computer Science;University of Cambridge

  • Venue:
  • Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present the first algorithm for automatically generating soundtracks for input animation based on other animations' soundtrack. This technique can greatly simplify the production of soundtracks in computer animation and video by re-targeting existing soundtracks. A segment of source audio is used to train a statistical model which is then used to generate variants of the original audio to fit particular constraints. These constraints can either be specified explicitly by the user in the form of large-scale properties of the sound texture, or determined automatically and semi-automatically by matching similar motion events in a source animation to those in the target animation.