View interpolation for image synthesis
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Multiple view geometry in computer visiond
Multiple view geometry in computer visiond
Unstructured lumigraph rendering
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Video matting of complex scenes
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Plenoptic Modeling and Rendering from Image Sequences Taken by Hand-Held Camera
Mustererkennung 1999, 21. DAGM-Symposium
Free-viewpoint video of human actors
ACM SIGGRAPH 2003 Papers
Video Google: A Text Retrieval Approach to Object Matching in Videos
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Visual Modeling with a Hand-Held Camera
International Journal of Computer Vision
Distinctive Image Features from Scale-Invariant Keypoints
International Journal of Computer Vision
High-quality video view interpolation using a layered representation
ACM SIGGRAPH 2004 Papers
An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision
IEEE Transactions on Pattern Analysis and Machine Intelligence
Synchronization and Calibration of Camera Networks from Silhouettes
ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01
A Quasi-Dense Approach to Surface Reconstruction from Uncalibrated Images
IEEE Transactions on Pattern Analysis and Machine Intelligence
Image-based spatio-temporal modeling and view interpolation of dynamic events
ACM Transactions on Graphics (TOG)
ACM SIGGRAPH 2005 Papers
Fusion of Multi-View Silhouette Cues Using a Space Occupancy Grid
ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Jump flooding in GPU with applications to Voronoi diagram and distance transform
I3D '06 Proceedings of the 2006 symposium on Interactive 3D graphics and games
Photo tourism: exploring photo collections in 3D
ACM SIGGRAPH 2006 Papers
A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Synthesizing Free-Viewpoint Images from Multiple View Videos in Soccer Stadium
CGIV '06 Proceedings of the International Conference on Computer Graphics, Imaging and Visualisation
Surface Capture for Performance-Based Animation
IEEE Computer Graphics and Applications
Scene completion using millions of photographs
ACM SIGGRAPH 2007 papers
VideoTrace: rapid interactive scene modelling from video
ACM SIGGRAPH 2007 papers
A Bayesian Framework for Simultaneous Matting and 3D Reconstruction
3DIM '07 Proceedings of the Sixth International Conference on 3-D Digital Imaging and Modeling
Dual-Mode Deformable Models for Free-Viewpoint Video of Sports Events
3DIM '07 Proceedings of the Sixth International Conference on 3-D Digital Imaging and Modeling
Synthesis and evaluation of linear motion transitions
ACM Transactions on Graphics (TOG)
A framework for video annotation, visualization, and interaction
A framework for video annotation, visualization, and interaction
Video browsing by direct manipulation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
DRAGON: a direct manipulation interface for frame-accurate in-scene video navigation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Finding paths through the world's photos
ACM SIGGRAPH 2008 papers
Unwrap mosaics: a new representation for video editing
ACM SIGGRAPH 2008 papers
Articulated mesh animation from multi-view silhouettes
ACM SIGGRAPH 2008 papers
Performance capture from sparse multi-view video
ACM SIGGRAPH 2008 papers
Deep photo: model-based photograph enhancement and viewing
ACM SIGGRAPH Asia 2008 papers
Interactive 3D architectural modeling from unordered photo collections
ACM SIGGRAPH Asia 2008 papers
Video object annotation, navigation, and composition
Proceedings of the 21st annual ACM symposium on User interface software and technology
Content-preserving warps for 3D video stabilization
ACM SIGGRAPH 2009 papers
Video SnapCut: robust video object cutout using localized classifiers
ACM SIGGRAPH 2009 papers
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part II
A tutorial on particle filters for online nonlinear/non-GaussianBayesian tracking
IEEE Transactions on Signal Processing
Motion capture from body-mounted cameras
ACM SIGGRAPH 2011 papers
Video-based characters: creating new human performances from a multi-view video database
ACM SIGGRAPH 2011 papers
Modeling dynamic scenes recorded with freely moving cameras
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
Joint Multi-Layer Segmentation and Reconstruction for Free-Viewpoint Video Applications
International Journal of Computer Vision
Towards plenoptic raumzeit reconstruction
Proceedings of the 2010 international conference on Video Processing and Computational Video
3D reconstruction and video-based rendering of casually captured videos
Proceedings of the 2010 international conference on Video Processing and Computational Video
Videoscapes: exploring sparse, unstructured video collections
ACM Transactions on Graphics (TOG) - SIGGRAPH 2012 Conference Proceedings
Viewpoint Selection for Human Actions
International Journal of Computer Vision
Video summagator: an interface for video summarization and navigation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Novel-View Synthesis of Outdoor Sport Events Using an Adaptive View-Dependent Geometry
Computer Graphics Forum
Making a scene: alignment of complete sets of clips based on pairwise audio match
Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
Brush-and-drag: a multi-touch interface for photo triaging
MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
Silhouette-aware warping for image-based rendering
EGSR'11 Proceedings of the Twenty-second Eurographics conference on Rendering
State of the Art Report on Video-Based Graphics and Video Visualization
Computer Graphics Forum
3D reconstruction of dynamic scenes with multiple handheld cameras
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
AR Record&Replay: situated compositing of video content in mobile augmented reality
Proceedings of the 24th Australian Computer-Human Interaction Conference
Interactive viewpoint video textures
Proceedings of the 9th European Conference on Visual Media Production
Integrating approximate depth data into dense image correspondence estimation
Proceedings of the 9th European Conference on Visual Media Production
Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
Preference and artifact analysis for video transitions of places
ACM Transactions on Applied Perception (TAP) - Special issue SAP 2013
Video collections in panoramic contexts
Proceedings of the 26th annual ACM symposium on User interface software and technology
| Hi-index | 0.00 |
We present an algorithm designed for navigating around a performance that was filmed as a "casual" multi-view video collection: real-world footage captured on hand held cameras by a few audience members. The objective is to easily navigate in 3D, generating a video-based rendering (VBR) of a performance filmed with widely separated cameras. Casually filmed events are especially challenging because they yield footage with complicated backgrounds and camera motion. Such challenging conditions preclude the use of most algorithms that depend on correlation-based stereo or 3D shape-from-silhouettes. Our algorithm builds on the concepts developed for the exploration of photo-collections of empty scenes. Interactive performer-specific view-interpolation is now possible through innovations in interactive rendering and offline-matting relating to i) modeling the foreground subject as video-sprites on billboards, ii) modeling the background geometry with adaptive view-dependent textures, and iii) view interpolation that follows a performer. The billboards are embedded in a simple but realistic reconstruction of the environment. The reconstructed environment provides very effective visual cues for spatial navigation as the user transitions between viewpoints. The prototype is tested on footage from several challenging events, and demonstrates the editorial utility of the whole system and the particular value of our new inter-billboard optimization.