PanoWalk: a remote image-based rendering system for mobile devices

Authors:
Zhongding Jiang;Yandong Mao;Qi Jia;Nan Jiang;Junyi Tao;Xiaochun Fang;Hujun Bao
Affiliations:
Computer Graphics Lab, Software School, Fudan University, Shanghai, China;Computer Graphics Lab, Software School, Fudan University, Shanghai, China;Computer Graphics Lab, Software School, Fudan University, Shanghai, China;Computer Graphics Lab, Software School, Fudan University, Shanghai, China;Computer Graphics Lab, Software School, Fudan University, Shanghai, China;Computer Graphics Lab, Software School, Fudan University, Shanghai, China;State Key Lab. of CAD&CG, Zhejiang University, Hangzhou, China
Venue:
PCM'06 Proceedings of the 7th Pacific Rim conference on Advances in Multimedia Information Processing
Year:
2006

Citing 14
Cited 0

QuickTime VR: an image-based approach to virtual environment navigation

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
The lumigraph

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Rendering with concentric mosaics

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
An accelerated remote graphics architecture for PDAS

Web3D '03 Proceedings of the eighth international conference on 3D Web technology
Enhancing 3D Graphics on Mobile Devices by Image-Based Rendering

PCM '02 Proceedings of the Third IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Level of Detail for 3D Graphics

Level of Detail for 3D Graphics
Remote Line Rendering for Mobile Devices

CGI '04 Proceedings of the Computer Graphics International
Streaming Scenes to MPEG-4 Video-Enabled Devices

IEEE Computer Graphics and Applications
CyberWalk: a web-based distributed virtual walkthrough environment

IEEE Transactions on Multimedia
On the compression and streaming of concentric mosaic data for free wandering in a realistic environment over the Internet

IEEE Transactions on Multimedia
A framework for remote rendering of 3-D scenes on limited mobile devices

IEEE Transactions on Multimedia
Survey of image-based representations and compression techniques

IEEE Transactions on Circuits and Systems for Video Technology
Data compression and transmission aspects of panoramic videos

IEEE Transactions on Circuits and Systems for Video Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Real-time rendering of complex 3D scene on mobile devices is a challenging task. The main reason is that mobile devices have limited computational capabilities and are lack of powerful 3D graphics hardware support. In this paper, we propose a remote Image-Based Rendering system for mobile devices to interactively visualize real world and synthetic scenes under wireless network. Our system uses panoramic video as building block of representing scene data. The scene data is compressed with one MPEG like encoding scheme tailored for mobile device. The compressed data is stored on remote server. Our system carefully partitions the rendering task between client and server. The server is responsible for determining the required data for rendering novel views. It streams the required data to client in server pushing manner. After receiving data, mobile client carries out rendering locally using image warping and displays the resultant images onto its small screen. Experimental results show that our system can achieve real time rendering speed on mainstream mobile devices. It allows multiple mobile clients to explore the same or different scenes simultaneously.