Virtual Reality in Brazil: Automatic camera control in virtual environments augmented using multiple sparse videos

Authors:
Jeferson R. Silva;Thiago T. Santos;Carlos H. Morimoto
Affiliations:
Department of Computer Science, University of São Paulo, Rua do Matão, 1010 São Paulo, CEP 05508-090, Brazil;Department of Computer Science, University of São Paulo, Rua do Matão, 1010 São Paulo, CEP 05508-090, Brazil;Department of Computer Science, University of São Paulo, Rua do Matão, 1010 São Paulo, CEP 05508-090, Brazil
Venue:
Computers and Graphics
Year:
2011

Citing 11
Cited 2

CamDroid: a system for implementing intelligent camera control

I3D '95 Proceedings of the 1995 symposium on Interactive 3D graphics
The virtual cinematographer: a paradigm for automatic real-time camera control and directing

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Single View Metrology

International Journal of Computer Vision
Video flashlights: real time rendering of multiple videos for immersive model visualization

EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
Augmented Virtual Environments (AVE): Dynamic Fusion of Imagery and 3D Models

VR '03 Proceedings of the IEEE Virtual Reality 2003
3D video surveillance with Augmented Virtual Environments

IWVS '03 First ACM SIGMM international workshop on Video surveillance
3D Surveillance A Distributed Network of Smart Cameras for Real-Time Tracking and its Visualization in 3D

CVPRW '06 Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop
People Detection under Occlusion in Multiple Camera Views

SIBGRAPI '08 Proceedings of the 2008 XXI Brazilian Symposium on Computer Graphics and Image Processing
Effects of Video Placement and Spatial Context Presentation on Path Reconstruction Tasks with Contextualized Videos

IEEE Transactions on Visualization and Computer Graphics
Heuristics for continuity editing of cinematic computer graphics scenes

Proceedings of the 2009 ACM SIGGRAPH Symposium on Video Games
Realtime generation of customized 3D animated explanations for knowledge-based learning environments

AAAI'97/IAAI'97 Proceedings of the fourteenth national conference on artificial intelligence and ninth conference on Innovative applications of artificial intelligence

Editorial: Special Section on Virtual Reality in Brazil

Computers and Graphics
Video collections in panoramic contexts

Proceedings of the 26th annual ACM symposium on User interface software and technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Automated virtual camera control has been widely used in animation and interactive virtual environments. We have developed a multiple sparse camera based free view video system prototype that allows users to control the position and orientation of a virtual camera, enabling the observation of a real scene in three dimensions (3D) from any desired viewpoint. Automatic camera control can be activated to follow selected objects by the user. Our method combines a simple geometric model of the scene composed of planes (virtual environment), augmented with visual information from the cameras and pre-computed tracking information of moving targets to generate novel perspective corrected 3D views of the virtual camera and moving objects. To achieve real-time rendering performance, view-dependent textured mapped billboards are used to render the moving objects at their correct locations and foreground masks are used to remove the moving objects from the projected video streams. The current prototype runs on a PC with a common graphics card and can generate virtual 2D views from three cameras of resolution 768x576 with several moving objects at about 11fps.