Numerical recipes in C (2nd ed.): the art of scientific computing
Numerical recipes in C (2nd ed.): the art of scientific computing
Digital video processing
A new method for camera motion parameter estimation
ICIP '95 Proceedings of the 1995 International Conference on Image Processing (Vol. 1)-Volume 1 - Volume 1
MDC: A Software Tool for Developing MPEG Applications
ICMCS '99 Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2
New frame rate up-conversion using bi-directional motion estimation
IEEE Transactions on Consumer Electronics
Adaptive motion-compensated interpolation for frame rate up-conversion
IEEE Transactions on Consumer Electronics
Coarse-to-fine frame interpolation for frame rate up-conversion using pyramid structure
IEEE Transactions on Consumer Electronics
Image quality assessment: from error visibility to structural similarity
IEEE Transactions on Image Processing
Adaptive motion-vector resampling for compressed video downscaling
IEEE Transactions on Circuits and Systems for Video Technology
Rapid estimation of camera motion from compressed video with application to video annotation
IEEE Transactions on Circuits and Systems for Video Technology
Object tracking for retrieval applications in MPEG-2
IEEE Transactions on Circuits and Systems for Video Technology
On spatial adaptation of motion-field smoothness in video coding
IEEE Transactions on Circuits and Systems for Video Technology
Submacroblock motion compensation for fast down-scale transcoding of compressed video
IEEE Transactions on Circuits and Systems for Video Technology
Video streaming application over WEAC protocol in MANET
Journal of Computer and System Sciences
Hi-index | 0.01 |
In this paper, we address the problem of video frame rate up-conversion (FRC) in the compressed domain. FRC is often recognized as video temporal interpolation. This problem is very challenging when targeted for video sequences with inconsistent camera and object motion, such as sports videos. A novel compressed domain motion compensation scheme is presented and applied in this paper, aiming at up-sampling frame rates in sports videos. MPEG-2 encoded motion vectors (MVs) are utilized as inputs in the proposed algorithm. The decoded MVs undergo a cumulative spatiotemporal interpolation. An iterative rejection scheme based on the dense motion vector field (MVF) and the generalized affine motion model is exploited to detect global camera motion. Subsequently, the foreground object separation is performed by additionally examining the temporal consistency of the output of iterative rejections. This consistency check process helps coalesce the resulting foreground blocks and weed out the unqualified blocks. Finally, different compensation strategies for the camera and object motions are applied to interpolate the new frames. Illustrative examples are provided to demonstrate the efficacy of the proposed approach. Experimental results are compared with the popular block and non-block based frame interpolation approaches.