Resource allocation for cloud-based free viewpoint video rendering for mobile phones

Authors:
Dan Miao;Wenwu Zhu;Chong Luo;Chang Wen Chen
Affiliations:
University of Science and Technology of China, Hefei, China;Microsoft Research Asia, Beijing, China;Microsoft Research Asia, Beijing, China;State University of New York at Buffalo, Buffalo, NY, USA
Venue:
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Year:
2011

Citing 5
Cited 1

View generation with 3D warping using depth information for FTV

Image Communication
Joint video/depth rate allocation for 3D video coding based on view synthesis distortion model

Image Communication
Real-time remote rendering of 3D video for mobile devices

MM '09 Proceedings of the 17th ACM international conference on Multimedia
Rate-distortion analysis for H.264/AVC video coding and its application to rate control

IEEE Transactions on Circuits and Systems for Video Technology
Rate-Distortion Optimization of Rate Control for H.264 With Adaptive Initial Quantization Parameter Determination

IEEE Transactions on Circuits and Systems for Video Technology

CAME: cloud-assisted motion estimation for mobile video compression and transmission

Proceedings of the 22nd international workshop on Network and Operating System Support for Digital Audio and Video

Quantified Score

Hi-index	0.00

Visualization

Abstract

Free viewpoint video (FVV) / Free viewpoint TV (FTV) on mobile devices over cellular networks is very challenging due to the requirement for large bandwidth and limitations in computation and battery life on mobile phones. To address such challenges, in this paper we propose a cloud-based FVV / FTV rendering framework for mobile devices over cellular networks. In this framework, cloud performs rendering for mobile devices. In order to achieve maximum QoE (Quality of Experience) for mobile users, we propose a novel resource allocation scheme, which jointly considers rendering allocation between cloud and client based on user's QoE and rate allocation among texture, depth, and channel rate based on rate-distortion analysis. We formulate this resource allocation scheme as an optimization problem which can then be transformed into a convex optimization for the given rate ratio. Experimental results demonstrate that the proposed cloud-based FVV rendering solution can substantially improve video quality on mobile devices comparing with traditional approaches.