Detection of object motion regions in aerial image pairs with a multilayer Markovian model
IEEE Transactions on Image Processing
Super-resolution sprite with foreground removal
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
High-resolution multi-sprite generation for background sprite coding
ACIVS'07 Proceedings of the 9th international conference on Advanced concepts for intelligent vision systems
Tennis Video 2.0: A new presentation of sports videos with content separation and rendering
Journal of Visual Communication and Image Representation
Sprite generation using sprite fusion
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Hi-index | 0.00 |
Object-oriented coding in the MPEG-4 standard enables the separate processing of foreground objects and the scene background (sprite). Since the background sprite only has to be sent once, transmission bandwidth can be saved. We have found that the counter-intuitive approach of splitting the background into several independent parts can reduce the overall amount of data. Furthermore, we show that in the general case, the synthesis of a single background sprite is even impossible and that the scene background must be sent as multiple sprites instead. For this reason, we propose an algorithm that provides an optimal partitioning of a video sequence into independent background sprites (a multisprite), resulting in a significant reduction of the involved coding cost. Additionally, our sprite-generation algorithm ensures that the sprite resolution is kept high enough to preserve all details of the input sequence, which is a problem especially during camera zoom-in operations. Even though our sprite generation algorithm creates multiple sprites instead of only a single background sprite, it is fully compatible with the existing MPEG-4 standard. The algorithm has been evaluated with several test sequences, including the well-known Table-tennis and Stefan sequences. The total coding cost for the sprite VOP is reduced by a factor of about 2.6 or even higher, depending on the sequence.