A novel interactive streaming protocol for image-based 3D virtual environment navigation

Authors:
Azzedine Boukerche;Raed Jarrar;Richard W. Pazzi
Affiliations:
PARADISE Laboratory, SITE, University of Ottawa, ON, Canada;PARADISE Laboratory, SITE, University of Ottawa, ON, Canada;PARADISE Laboratory, SITE, University of Ottawa, ON, Canada
Venue:
ICC'09 Proceedings of the 2009 IEEE international conference on Communications
Year:
2009

Citing 7
Cited 3

View morphing

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Mathematics for 3D game programming and computer graphics

Mathematics for 3D game programming and computer graphics
Rail-track viewer: an image-based virtual walkthrough system

EGVE '02 Proceedings of the workshop on Virtual environments 2002
Image-Based Rendering

Image-Based Rendering
Remote rendering and streaming of progressive panoramas for mobile devices

MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Dual-Mode Deformable Models for Free-Viewpoint Video of Sports Events

3DIM '07 Proceedings of the Sixth International Conference on 3-D Digital Imaging and Modeling
An end-to-end virtual environment streaming technique for thin mobile devices over heterogeneous networks

Computer Communications

A novel 3D streaming protocol supported multi-mode display

Journal of Network and Computer Applications
Collaborative view synthesis for interactive multi-view video streaming

Proceedings of the 22nd international workshop on Network and Operating System Support for Digital Audio and Video
A scalable architecture for 3D map navigation on mobile devices

Personal and Ubiquitous Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Image-based rendering (IBR) has attracted recent attention mainly due to its low requirements for generating new scenes based on a sequence of reference images. IBR has paved the way for a new class of application, the Free Viewpoint Television (FTV), which allows the viewer to interactively control the camera and move freely within a scene. IBR can also be used to render complex 3D virtual environments on graphics-constrained devices, such as cellphones and PDAs. In this paper, we propose a new protocol that offers the user a richer virtual experience by pre-streaming the necessary imagery data to generate new views as the user wanders within a 3D environment. We introduce the idea of key partial panoramas, i.e., panorama segments that cover movements in any direction by simply strafing from an appropriate key partial panorama and streaming the amount of lost pixels. We have implemented our protocols and evaluated them against two well-known approaches. Experimental results show that our solution outperforms the selected approaches, by minimizing the delay between image updates and by allowing for a more complex navigation scheme.