Stereoscopic video coding and disparity estimation for low bitrate applications based on MPEG-4 multiple auxiliary components

Authors:
Jiyoung Kim;Yongtae Kim;Kwanghoon Sohn
Affiliations:
Department of Electrical and Electronic Engineering, Yonsei University, 134 Shinchon-dong, Seodaemun-gu, Seoul 120-749, South Korea;Samsung Electronics, Suwon, Gyeonggi-do, South Korea;Department of Electrical and Electronic Engineering, Yonsei University, 134 Shinchon-dong, Seodaemun-gu, Seoul 120-749, South Korea
Venue:
Image Communication
Year:
2008

Citing 7
Cited 0

An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences

IEEE Transactions on Pattern Analysis and Machine Intelligence
A maximum likelihood stereo algorithm

Computer Vision and Image Understanding
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms

International Journal of Computer Vision
Advances in Computational Stereo

IEEE Transactions on Pattern Analysis and Machine Intelligence
Edge-preserving directional regularization technique for disparity estimation of stereoscopic images

IEEE Transactions on Consumer Electronics
Adaptive Local Illumination Change Compensation Method for H.264/AVC-Based Multiview Video Coding

IEEE Transactions on Circuits and Systems for Video Technology
New Coding Tools for Illumination and Focus Mismatch Compensation in Multiview Video Coding

IEEE Transactions on Circuits and Systems for Video Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Using an MPEG-4 MAC (multiple auxiliary component) system is a good way to encode stereoscopic video with existing standard CODECs, especially when it comes to low bitrate applications. In this paper, we discuss the properties and problems of MAC systems when encoding stereoscopic video, and propose an MAC-based stereoscopic video coder and disparity estimation scheme to solve those problems. We used a reconstructed disparity map during the disparity compensation process and took that disparity map into account while estimating the base-view sequence motion vectors. Moreover, we proposed a search range finding and illumination imbalance decision system. We also proposed a block-based disparity map regularization process as well as block splitting in the object boundary and occlusion regions (to reduce the number of bits to encode in both the disparity map and the residual image). Last, we compensated for the imbalance between two cameras with a novel system that used MAC characteristics. Experimental results indicate that the proposed MAC system outperformed conventional stereo coding systems by a maximum of 3.5dB in terms of the PSNR and 10-18% in terms of bitsaving, especially in low bitrate applications.