A photorealistic predictive display

Authors:
Tim Burkert;Jan Leupold;Georg Passig
Affiliations:
-;Institute for Real-Time Computer Systems, Technische Universität München, Arcisstrasse 21, D-80333 Munich, Germany;Institute for Real-Time Computer Systems, Technische Universität München, Arcisstrasse 21, D-80333 Munich, Germany
Venue:
Presence: Teleoperators and Virtual Environments - Special section: Advances in interactive multimodal telepresent systems
Year:
2004

Citing 10
Cited 3

Efficacy of a predictive display, steering device, and vehicle body representation in the operation of a lunar vehicle

Conference Companion on Human Factors in Computing Systems
Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Accurate natural surface reconstruction from polynocular stereo

Confluence of computer vision and computer graphics
Online model reconstruction for interactive virtual environments

I3D '01 Proceedings of the 2001 symposium on Interactive 3D graphics
Virtualized Reality: Constructing Virtual Worlds from Real Scenes

IEEE MultiMedia
A Cooperative Algorithm for Stereo Matching and Occlusion Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator

FCRC '96/WACG '96 Selected papers from the Workshop on Applied Computational Geormetry, Towards Geometric Engineering
Discrimination of changes in latency during head movement

Proceedings of the HCI International '99 (the 8th International Conference on Human-Computer Interaction) on Human-Computer Interaction: Communication, Cooperation, and Application Design-Volume 2 - Volume 2
3D Video Recorder

PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
Stereo-based environment scanning for immersive telepresence

IEEE Transactions on Circuits and Systems for Video Technology

An HCI method to improve the human performance reduced by local-lag mechanism

Interacting with Computers
Human Factors for Enhancing Live Video Streams with Virtual Reality: Performance, Situation Awareness, and Feeling of Telepresence

Presence: Teleoperators and Virtual Environments
A semi-automatic 3d reconstruction algorithm for telepresence

ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

The quality of a teleoperation system is decreased by time delays in the communication channel. Delays as low as a few hundred milliseconds between commanding an action and getting the visual feedback reduce the operator's performance. Predictive displays have proven their suitability to compensate for these delays, but at the expense of image quality when using computer-generated images. A photorealistic predictive display is presented that closes the feedback loop locally at the operator's side of a telepresence system. Photorealism is achieved using delayed camera images for texturing the predicted scene. Consumer graphics hardware is not only used for rendering but also for hardware-accelerated texture extraction. To allow concurrent access to model data, a multibuffer model structure is presented. A model or the teleoperator's environment is automatically acquired and updated by image processing techniques using a stereo camera as the only sensor.