Single webcam 3D tracking for video games

Authors:
David Scherfgen;Rainer Herpers;Timur Saitov
Affiliations:
Bonn-Rhein-Sieg University of Applied Sciences, St. Augustin, Germany;Bonn-Rhein-Sieg University of Applied Sciences, St. Augustin, Germany and York University, Toronto, Canada and University of New Brunswick, Fredericton, Canada;Bonn-Rhein-Sieg University of Applied Sciences, St. Augustin, Germany
Venue:
Futureplay '10 Proceedings of the International Academic Conference on the Future of Game Design and Technology
Year:
2010

Citing 3
Cited 0

A Computational Approach to Edge Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Efficient Invariant Representations

International Journal of Computer Vision
PnP Problem Revisited

Journal of Mathematical Imaging and Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

This contribution presents an easy to implement 3D tracking approach that works with a single standard webcam. We describe the algorithm and show that it is well suited for being used as an intuitive interaction method in 3D video games. The algorithm can detect and distinguish multiple objects in real-time and obtain their orientation and position relative to the camera. The trackable objects are equipped with planar patterns of five visual markers. By tracking (stereo) glasses worn by the user and adjusting the in-game camera's viewing frustum accordingly, the well-known immersive "screen as a window" effect can be achieved, even without the use of any special tracking equipment.