Nonlinear optimization framework for image-based modeling on programmable graphics hardware
ACM SIGGRAPH 2003 Papers
Performance evaluation of programmable graphics hardware for image filtering and stereo matching
Proceedings of the ACM symposium on Virtual reality software and technology
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
Accelerated epipolar geometry computation for 3D reconstruction using projective texturing
Proceedings of the 20th spring conference on Computer graphics
Real time 3D avatar for interactive mixed reality
VRCAI '04 Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry
Towards space: time light field rendering
Proceedings of the 2005 symposium on Interactive 3D graphics and games
UberFlow: a GPU-based particle engine
Proceedings of the ACM SIGGRAPH/EUROGRAPHICS conference on Graphics hardware
A versatile stereo implementation on commodity graphics hardware
Real-Time Imaging
Occlusion in mirror-based co-located augmented reality systems
Presence: Teleoperators and Virtual Environments - Special issue: IEEE VR 2005
Layered probability maps: basic framework and prototype system
Proceedings of the ACM symposium on Virtual reality software and technology
A self-reconfigurable camera array
SIGGRAPH '04 ACM SIGGRAPH 2004 Sketches
Nonlinear optimization framework for image-based modeling on programmable graphics hardware
SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
Efficient multi-viewpoint acquisition of 3D objects undergoing repetitive motions
Proceedings of the 2007 symposium on Interactive 3D graphics and games
Space-Time Light Field Rendering
IEEE Transactions on Visualization and Computer Graphics
Foundations and Trends® in Computer Graphics and Vision
Modulating the shape and size of backprojection surfaces to improve accuracy in volumetric stereo
EURASIP Journal on Applied Signal Processing - 3DTV: Capture, Transmission, and Display of 3D Video
EURASIP Journal on Applied Signal Processing - 3DTV: Capture, Transmission, and Display of 3D Video
Mutual Information Based Semi-Global Stereo Matching on the GPU
ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing
Real-Time Space Carving Using Graphics Hardware
IEICE - Transactions on Information and Systems
On-line modeling for real-time 3D target tracking
Machine Vision and Applications
Obtaining Reliable Depth Maps for Robotic Applications from a Quad-Camera System
ICIRA '09 Proceedings of the 2nd International Conference on Intelligent Robotics and Applications
Stream-centric stereo matching and view synthesis: a high-speed approach on GPUs
IEEE Transactions on Circuits and Systems for Video Technology
Watertight multi-view reconstruction based on volumetric graph-cuts
SCIA'07 Proceedings of the 15th Scandinavian conference on Image analysis
Real-time free viewpoint from multiple moving cameras
ACIVS'07 Proceedings of the 9th international conference on Advanced concepts for intelligent vision systems
Online multiple view computation for autostereoscopic display
PSIVT'07 Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology
Real-time video-based rendering from uncalibrated cameras using plane-sweep algorithm
Journal of Visual Communication and Image Representation
Axial-cones: modeling spherical catadioptric cameras for wide-angle light field rendering
ACM SIGGRAPH Asia 2010 papers
Multi-resolution real-time stereo on commodity graphics hardware
CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
GPU-based active contour segmentation using gradient vector flow
ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part I
On-line novel view synthesis capable of handling multiple moving objects
ICCV'05 Proceedings of the 2005 international conference on Computer Vision in Human-Computer Interaction
PSIVT'11 Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part I
A self-reconfigurable camera array
EGSR'04 Proceedings of the Fifteenth Eurographics conference on Rendering Techniques
OmniKinect: real-time dense volumetric data acquisition and applications
Proceedings of the 18th ACM symposium on Virtual reality software and technology
Scalable multi-view registration for multi-projector displays on vertically extruded surfaces
EuroVis'10 Proceedings of the 12th Eurographics / IEEE - VGTC conference on Visualization
| Hi-index | 0.00 |
We present a novel use of commodity graphics hardware that effectively combines a plane-sweeping algorithm with view synthesis for real-time, on-line 3D scene acquisition and view synthesis. Using real-time imagery from a few calibrated cameras, our method can generate new images from nearby viewpoints, estimate a dense depth map from the current viewpoint, or create a textured triangular mesh. We can do each of these without any prior geometric information or requiring any user interaction, in real time and on line. The heart of our method is to use programmable Pixel Shader technology to square intensity differences between reference image pixels, and then to choose final colors (or depths) that correspond to the minimum difference, i.e. the most consistent color.In this paper we describe the method, place it in the context of related work in computer graphics and computer vision, and present some results.