Polygon-assisted JPEG and MPEG compression of synthetic images
SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
An image-based approach to three-dimensional computer graphics
An image-based approach to three-dimensional computer graphics
Video Processing and Communications
Video Processing and Communications
Postrendering 3d image warping: visibility, reconstruction, and performance for depth-image warping
Postrendering 3d image warping: visibility, reconstruction, and performance for depth-image warping
The effects of loss and latency on user performance in unreal tournament 2003®
Proceedings of 3rd ACM SIGCOMM workshop on Network and system support for games
A cognitive approach for effective coding and transmission of 3D video
Proceedings of the international conference on Multimedia
A high-quality low-delay remote rendering system for 3D video
Proceedings of the international conference on Multimedia
Overview of the H.264/AVC video coding standard
IEEE Transactions on Circuits and Systems for Video Technology
A Novel Rate Control Scheme for Low Delay Video Communication of H.264/AVC Standard
IEEE Transactions on Circuits and Systems for Video Technology
A real-time remote rendering system for interactive mobile graphics
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special section of best papers of ACM multimedia 2011, and special section on 3D mobile multimedia
Game as video: bit rate reduction through adaptive object encoding
Proceeding of the 23rd ACM Workshop on Network and Operating Systems Support for Digital Audio and Video
GamingAnywhere: an open cloud gaming system
Proceedings of the 4th ACM Multimedia Systems Conference
GamingAnywhere: The first open source cloud gaming system
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special issue of best papers of ACM MMSys 2013 and ACM NOSSDAV 2013
Layered Coding for Mobile Cloud Gaming
Proceedings of International Workshop on Massively Multiuser Virtual Environments
Quantifying User Satisfaction in Mobile Cloud Games
Proceedings of Workshop on Mobile Video Delivery
Hi-index | 0.00 |
The emerging cloud gaming service has been growing rapidly, but not yet able to reach mobile customers due to many limitations, such as bandwidth and latency. We introduce a 3D image warping assisted real-time video coding method that can potentially meet all the requirements of mobile cloud gaming. The proposed video encoder selects a set of key frames in the video sequence, uses the 3D image warping algorithm to interpolate other non-key frames, and encodes the key frames and the residues frames with an H.264/AVC encoder. Our approach is novel in taking advantage of the run-time graphics rendering contexts (rendering viewpoint, pixel depth, camera motion, etc.) from the 3D game engine to enhance the performance of video encoding for the cloud gaming service. The experiments indicate that our proposed video encoder has the potential to beat the state-of-art x264 encoder in the scenario of real-time cloud gaming. For example, by implementing the proposed method in a 3D tank battle game, we experimentally show that more than 2 dB quality improvement is possible.