Bitstream syntax description-based adaptation in streaming and constrained environments

• Authors: S. Devillers;C. Timmerer;J. Heuer;H. Hellwagner
• Venue: IEEE Transactions on Multimedia
• Year: 2005

The seamless access to rich multimedia content on any device and over any network, usually known as Universal Multimedia Access, requires interoperable description tools and adaptation techniques to be developed. To address the latter issue, MPEG-21 Digital Item Adaptation (DIA) introduces the Bitstream Syntax Description (BSD) framework, which provides tools for adapting multimedia content in a generic (i.e., coding format independent) way. The basic idea is to use the eXtensible Markup Language (XML) to describe the high-level structure of a binary media bitstream, to transform its description [e.g., by means of eXtensible Stylesheet Language Transformations (XSLT)], and to construct the adapted media bitstream from the transformed description. This paper presents how this basic BSD framework, initially developed for nonstreamed content and suffering from inherent limitations and high memory consumption of XML-related technologies such as XSLT, can be advanced and efficiently implemented in a streaming environment and on resource-constrained devices. Two different attempts to solve the inherent problems are described. The first approach proposes an architecture based on the streamed processing of Simple Application Programming Interface for XML (SAX) events and adopts Streaming Transformations for XML (STX) as an alternative to XSLT, whereas the second approach breaks a BSD up into well-formed fragments called process units that can be processed individually by a standard XSLT processor. The current status of our work, as well as directions for future research, are given.