The Visual Hull Concept for Silhouette-Based Image Understanding
IEEE Transactions on Pattern Analysis and Machine Intelligence
Incorporating dynamic real objects into immersive virtual environments
I3D '03 Proceedings of the 2003 symposium on Interactive 3D graphics
A high performance multi-perspective vision studio
ICS '03 Proceedings of the 17th annual international conference on Supercomputing
Resolving Occlusion in Augmented Reality: a Contour Based Approach without 3D Reconstruction
CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
AR2 Hockey: A Case Study of Collaborative Augmented Reality
VRAIS '98 Proceedings of the Virtual Reality Annual International Symposium
3D Live: Real Time Captured Content for Mixed Reality
ISMAR '02 Proceedings of the 1st International Symposium on Mixed and Augmented Reality
3D Reconstruction of Stereo Images for Interaction between Real and Virtual Worlds
ISMAR '03 Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality
Parallel Pipeline Volume Intersection for Real-Time 3D Shape Reconstruction on a PC Cluster
ICVS '06 Proceedings of the Fourth IEEE International Conference on Computer Vision Systems
A convenient multicamera self-calibration for virtual environments
Presence: Teleoperators and Virtual Environments
Visual Hull Construction in the Presence of Partial Occlusion
3DPVT '06 Proceedings of the Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06)
Grimage: markerless 3D interactions
ACM SIGGRAPH 2007 emerging technologies
Robust background subtraction for quick illumination changes
PSIVT'06 Proceedings of the First Pacific Rim conference on Advances in Image and Video Technology
A real-time system for full body interaction with virtual worlds
EGVE'04 Proceedings of the Tenth Eurographics conference on Virtual Environments
| Hi-index | 0.00 |
In this paper, we present a system for performing real-time occlusion-aware interactions in a mixed reality environment. Our system consists of 16 ceiling-mounted cameras observing an interaction space of size 3.70 m x 3.20 m x 2.20 m. We reconstruct the shape of all objects inside the interaction space using a visual hull method at a frame rate of 30 Hz. Due to the interactive speed of the system, the users can act naturally in the interaction space. In addition, since we reconstruct the shape of every object, the users can use their entire body to interact with the virtual objects. This is a significant advantage over marker-based tracking systems, which require a prior setup and tedious calibration steps for every user who wants to use the system. With our system anybody can just enter the interaction space and start interacting naturally. We illustrate the usefulness of our system through two sample applications. The first application is a real-life version of the well known game Pong. With our system, the player can use his whole body as the pad. The second application is concerned with video compositing. It allows a user to integrate himself as well as virtual objects into a prerecorded sequence while correctly handling occlusions.