A real-time multimedia composition layer

  • Authors:
  • Stefan Müller;Simon Schubiger-Banz;Matthias Specht

  • Affiliations:
  • ETH Zurich, Zurich;Swisscom Innovations, Bern;University of Zurich

  • Venue:
  • Proceedings of the 1st ACM workshop on Audio and music computing multimedia
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We introduce a light-weight multimedia composition layer which is situated on top of existing music, sound, and graphics frameworks and libraries. The layer provides applications with a programming interface for multimedia composition, automating real-time media processing and synchronisation. Our work facilitates the mapping of media frameworks to a unified processing graph. We present a graph segmentation algorithm that solves the problem of communication between threads of multiple frameworks while providing global consistency and without affecting processing performance. In addition, support for logical and physical time is included and enables framework-independent realisation of complex multimedia designs. The paper discusses the layer's architecture in detail and shows how multimedia applications can efficiently exploit its capabilities.