Shake'n'sense: reducing interference for overlapping structured light depth cameras
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
OmniKinect: real-time dense volumetric data acquisition and applications
Proceedings of the 18th ACM symposium on Virtual reality software and technology
Real-time compression of depth streams through meshification and valence-based encoding
Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
3D helping hands: a gesture based MR system for remote collaboration
Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
Kinect-Based easy 3D object reconstruction
PCM'12 Proceedings of the 13th Pacific-Rim conference on Advances in Multimedia Information Processing
A framework for realistic 3D tele-immersion
Proceedings of the 6th International Conference on Computer Vision / Computer Graphics Collaboration Techniques and Applications
Real-time high-resolution sparse voxelization with application to image-based modeling
Proceedings of the 5th High-Performance Graphics Conference
Photoportals: shared references in space and time
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Proceedings of the 10th European Conference on Visual Media Production
RemoteFusion: real time depth camera fusion for remote collaboration on physical tasks
Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
A low-latency 3D teleconferencing system with image based approach
Proceedings of the 12th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
Hi-index | 0.00 |
This paper introduces a proof-of-concept telepresence system that offers fully dynamic, real-time 3D scene capture and continuous-viewpoint, head-tracked stereo 3D display without requiring the user to wear any tracking or viewing apparatus. We present a complete software and hardware framework for implementing the system, which is based on an array of commodity Microsoft Kinect聶color-plus-depth cameras. Novel contributions include an algorithm for merging data between multiple depth cameras and techniques for automatic color calibration and preserving stereo quality even with low rendering rates. Also presented is a solution to the problem of interference that occurs between Kinect cameras with overlapping views. Emphasis is placed on a fully GPU-accelerated data processing and rendering pipeline that can apply hole filling, smoothing, data merger, surface generation, and color correction at rates of up to 100 million triangles/sec on a single PC and graphics board. Also presented is a Kinect-based markerless tracking system that combines 2D eye recognition with depth information to allow head-tracked stereo views to be rendered for a parallax barrier autostereoscopic display. Our system is affordable and reproducible, offering the opportunity to easily deliver 3D telepresence beyond the researcher's lab.