Proceedings of the 1997 symposium on Interactive 3D graphics
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Unstructured lumigraph rendering
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
3D Live: Real Time Captured Content for Mixed Reality
ISMAR '02 Proceedings of the 1st International Symposium on Mixed and Augmented Reality
blue-c: a spatially immersive display and 3D video portal for telepresence
ACM SIGGRAPH 2003 Papers
Image-based rendering using image-based priors
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
View synthesis of articulating humans using visual hull
ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
Hardware-accelerated jaggy-free visual hulls with silhouette maps
Proceedings of the ACM symposium on Virtual reality software and technology
View synthesis by the parallel use of GPU and CPU
Image and Vision Computing
GPU-based shape from silhouettes
Proceedings of the 5th international conference on Computer graphics and interactive techniques in Australia and Southeast Asia
Performance capture from sparse multi-view video
ACM SIGGRAPH 2008 papers
Real-Time Space Carving Using Graphics Hardware
IEICE - Transactions on Information and Systems
Parallel high resolution real-time visual hull on GPU
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
A hybrid approach for computing visual hulls of complex objects
CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
A free-viewpoint virtual mirror with marker-less user interaction
SCIA'11 Proceedings of the 17th Scandinavian conference on Image analysis
Free viewpoint virtual try-on with commodity depth cameras
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
Softshell: dynamic scheduling on GPUs
ACM Transactions on Graphics (TOG) - Proceedings of ACM SIGGRAPH Asia 2012
Hi-index | 0.01 |
Many mixed reality systems require the real-time capture and re-rendering of the real world to integrate real objects more closely with the virtual graphics. This includes novel view-point synthesis for virtual mirror or telepresence applications. For real-time performance, the latency between capturing the real world and producing the virtual output needs to be as little as possible. Image-based visual hull (IBVH) rendering is capable of rendering novel views from segmented images in real time. We improve upon existing IBVH implementations in terms of robustness and performance by reformulating the tasks of major components. Moreover, we enable high resolutions and little latency by exploiting view- and frame coherence. The suggested algorithm includes image warping between successive frames under the constraint of redraw volumes. These volumes form a boundary of the motion and deformation in the scene, and can be constructed efficiently by describing them as the visual hull of a set of bounding rectangles which are cast around silhouette differences in image-space. As a result, our method can handle arbitrarily moving and deforming foreground objects and free viewpoint motion at the same time, while still being able to reduce workload by reusing previous rendering results.