Visual Modeling with a Hand-Held Camera

Authors:
Marc Pollefeys;Luc Van Gool;Maarten Vergauwen;Frank Verbiest;Kurt Cornelis;Jan Tops;Reinhard Koch
Affiliations:
Department of Computer Science, University of North Carolina, Chapel Hill, NC 27599-3175, USA. marc@cs.unc.edu;Center for Processing of Speech and Images, Katholieke Universiteit Leuven, Kasteelpark Arenberg 10, B-3001 Leuven, Belgium. Luc.VanGool@esat.kuleuven.ac.be;Center for Processing of Speech and Images, Katholieke Universiteit Leuven, Kasteelpark Arenberg 10, B-3001 Leuven, Belgium. Maarten.Vergauwen@esat.kuleuven.ac.be;Center for Processing of Speech and Images, Katholieke Universiteit Leuven, Kasteelpark Arenberg 10, B-3001 Leuven, Belgium. Frank.Verbiest@esat.kuleuven.ac.be;Center for Processing of Speech and Images, Katholieke Universiteit Leuven, Kasteelpark Arenberg 10, B-3001 Leuven, Belgium. Kurt.Cornelis@esat.kuleuven.ac.be;Center for Processing of Speech and Images, Katholieke Universiteit Leuven, Kasteelpark Arenberg 10, B-3001 Leuven, Belgium. Jan.Tops@esat.kuleuven.ac.be;Institut für Informatik und Praktische Mathematik, Christian-Albrechts-Universität Kiel, Hermann-Rodewald-Str. 3, D-24098 Kiel, Germany. rk@mip.informatik.uni-kiel.de
Venue:
International Journal of Computer Vision
Year:
2004

Citing 50
Cited 129

Marching cubes: A high resolution 3D surface construction algorithm

SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Robust regression and outlier detection

Robust regression and outlier detection
Decimation of triangle meshes

SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
Shape and motion from image streams under orthography: a factorization method

International Journal of Computer Vision
Numerical recipes in C (2nd ed.): the art of scientific computing

Numerical recipes in C (2nd ed.): the art of scientific computing
Zippered polygon meshes from range images

SIGGRAPH '94 Proceedings of the 21st annual conference on Computer graphics and interactive techniques
Modeling and calibration of automated zoom lenses

Modeling and calibration of automated zoom lenses
A General Surface Approach to the Integration of a Set of Range Views

IEEE Transactions on Pattern Analysis and Machine Intelligence
Plenoptic modeling: an image-based rendering system

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry

Artificial Intelligence - Special volume on computer vision
A maximum likelihood stereo algorithm

Computer Vision and Image Understanding
Modeling and rendering architecture from photographs: a hybrid geometry- and image-based approach

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Light field rendering

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
The lumigraph

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
A volumetric method for building complex models from range images

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Local Grayvalue Invariants for Image Retrieval

IEEE Transactions on Pattern Analysis and Machine Intelligence
Sequential Updating of Projective and Affine Structure from Motion

International Journal of Computer Vision
In Defense of the Eight-Point Algorithm

IEEE Transactions on Pattern Analysis and Machine Intelligence
Triangulation

Computer Vision and Image Understanding
Chirality

International Journal of Computer Vision
Stratified Self-Calibration with the Modulus Constraint

IEEE Transactions on Pattern Analysis and Machine Intelligence
Self-Calibration and Metric Reconstruction Inspite of Varying and Unknown Intrinsic Camera Parameters

International Journal of Computer Vision - 1998 Marr Prize
Plenoptic sampling

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Multiple view geometry in computer vision

Multiple view geometry in computer vision
Unstructured lumigraph rendering

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
The Geometry of Multiple Images: The Laws That Govern The Formation of Images of A Scene and Some of Their Applications

The Geometry of Multiple Images: The Laws That Govern The Formation of Images of A Scene and Some of Their Applications
A Theory of Shape by Space Carving

International Journal of Computer Vision - Special issue on Genomic Signal Processing
A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms

International Journal of Computer Vision
A Hierarchical Symmetric Stereo Algorithm Using Dynamic Programming

International Journal of Computer Vision
Multiresolution Textures from Image Sequences

IEEE Computer Graphics and Applications
A Multiple-Baseline Stereo

IEEE Transactions on Pattern Analysis and Machine Intelligence
Camera Self-Calibration: Theory and Experiments

ECCV '92 Proceedings of the Second European Conference on Computer Vision
What can be seen in three dimensions with an uncalibrated stereo rig

ECCV '92 Proceedings of the Second European Conference on Computer Vision
Robust Video Mosaicing through Topology Inference and Local to Global Alignment

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
Oriented Projective Geometry for Computer Vision

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume I - Volume I
Automatic Camera Recovery for Closed or Open Image Sequences

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume I - Volume I
Multi Viewpoint Stereo from Uncalibrated Video Sequences

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume I - Volume I
Surviving Dominant Planes in Uncalibrated Structure and Motion Recovery

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part II
Augmented Reality Using Uncalibrated Video Sequences

SMILE '00 Revised Papers from Second European Workshop on 3D Structure from Multiple Images of Large-Scale Environments
Plenoptic Modeling and Rendering from Image Sequences Taken by Hand-Held Camera

Mustererkennung 1999, 21. DAGM-Symposium
Euclidean Reconstruction from Uncalibrated Views

Proceedings of the Second Joint European - US Workshop on Applications of Invariance in Computer Vision
Autocalibration and the absolute quadric

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Euclidean Reconstruction from Image Sequences with Varying and Unknown Focal Length and Principal Point

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Critical Motion Sequences for Monocular Self-Calibration and Uncalibrated Euclidean Reconstruction

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Euclidean Reconstruction from Constant Intrinsic Parameters

ICPR '96 Proceedings of the 1996 International Conference on Pattern Recognition (ICPR '96) Volume I - Volume 7270
Object Recognition from Local Scale-Invariant Features

ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Maintaining Multiple Motion Model Hypotheses Over Many Views to Recover Matching and Structure

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Consensus Surfaces for Modeling 3D Objects from Multiple Range Images

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Self-Calibration and Metric Reconstruction in spite of Varying and Unknown Internal Camera Parameters

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision

Real-time multidepth stream compression

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Automatic photo pop-up

ACM SIGGRAPH 2005 Papers
Distributed localization of networked cameras

Proceedings of the 5th international conference on Information processing in sensor networks
Photo tourism: exploring photo collections in 3D

ACM SIGGRAPH 2006 Papers
RotoTexture: Automated Tools for Texturing Raw Video

IEEE Transactions on Visualization and Computer Graphics
Dense 3D reconstruction from images by normal aided matching

Machine Graphics & Vision International Journal
Multiview fusion for canonical view generation based on homography constraints

Proceedings of the 4th ACM international workshop on Video surveillance and sensor networks
A recursive camera resectioning technique for off-line video-based augmented reality

Pattern Recognition Letters
Stereoscopic Video Synthesis from a Monocular Video

IEEE Transactions on Visualization and Computer Graphics
Robust multi-view feature matching from multiple unordered views

Pattern Recognition
Visually Mapping the RMS Titanic: Conservative Covariance Estimates for SLAM Information Filters

International Journal of Robotics Research
VideoTrace: rapid interactive scene modelling from video

ACM SIGGRAPH 2007 papers
Using depth features to retrieve monocular video shots

Proceedings of the 6th ACM international conference on Image and video retrieval
Omnidirectional Vision Based Topological Navigation

International Journal of Computer Vision
A shape hierarchy for 3D modelling from video

Proceedings of the 5th international conference on Computer graphics and interactive techniques in Australia and Southeast Asia
Minimal Aspect Distortion (MAD) Mosaicing of Long Scenes

International Journal of Computer Vision
Integrating Automated Range Registration with Multiview Geometry for the Photorealistic Modeling of Large-Scale Scenes

International Journal of Computer Vision
Finding paths through the world's photos

ACM SIGGRAPH 2008 papers
3D-modeling by ortho-image generation from image sequences

ACM SIGGRAPH 2008 papers
Image based modelling with VideoTrace

ACM SIGGRAPH Computer Graphics
Interactive 3D architectural modeling from unordered photo collections

ACM SIGGRAPH Asia 2008 papers
Modeling the World from Internet Photo Collections

International Journal of Computer Vision
Implicit Feedback between Reconstruction and Tracking in a Combined Optimization Approach

Proceedings of the 30th DAGM symposium on Pattern Recognition
Morphable 3D-mosaics: a hybrid framework for photorealistic walkthroughs of large natural environments

Advances in Multimedia
Computer-Guided Laparoscopic Training with Application of a Fuzzy Expert System

MICAI '08 Proceedings of the 7th Mexican International Conference on Artificial Intelligence: Advances in Artificial Intelligence
SBA: A software package for generic sparse bundle adjustment

ACM Transactions on Mathematical Software (TOMS)
3DTV view generation using uncalibrated pure rotating and zooming cameras

Image Communication
Technical Section: Advanced tracking through efficient image processing and visual-inertial sensor fusion

Computers and Graphics
Video-Based Motion Capturing for Skeleton-Based 3D Models

PSIVT '09 Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video Technology
3D modeling of complex and detailed cultural heritage using multi-resolution data

Journal on Computing and Cultural Heritage (JOCCH)
Accurate Camera Calibration from Multi-View Stereo and Bundle Adjustment

International Journal of Computer Vision
Parallax photography: creating 3D cinematic effects from stills

Proceedings of Graphics Interface 2009
Conflict resolution in a knowledge-based system using multiple attribute decision-making

Expert Systems with Applications: An International Journal
Digital Modeling of Material Appearance

Digital Modeling of Material Appearance
FixTag: An algorithm for identifying and tagging fixations to simplify the analysis of data collected by portable eye trackers

ACM Transactions on Applied Perception (TAP)
A 3-Component Inverse Depth Parameterization for Particle Filter SLAM

Proceedings of the 31st DAGM Symposium on Pattern Recognition
A framework for modeling 3D scenes using pose-free equations

ACM Transactions on Graphics (TOG)
Spatio-temporal constraints for on-line 3D object recognition in videos

Computer Vision and Image Understanding
Virtual view specification and synthesis for free viewpoint television

IEEE Transactions on Circuits and Systems for Video Technology
Robot control via region-based 3d reconstruction

ISC '07 Proceedings of the 10th IASTED International Conference on Intelligent Systems and Control
Using image-based modeling for exporting 3D content from Second Life

Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry
Exploiting Mutual Camera Visibility in Multi-camera Motion Estimation

ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part I
Factorization of Correspondence and Camera Error for Unconstrained Dense Correspondence Applications

ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part I
Depth from Encoded Sliding Projections

ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part I
The Vision System of the ACROBOTER Project

ICIRA '09 Proceedings of the 2nd International Conference on Intelligent Robotics and Applications
Airborne smoothing and mapping using vision and inertial sensors

ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation
Horizon matching for localizing unordered panoramic images

Computer Vision and Image Understanding
Camera Network Calibration and Synchronization from Silhouettes in Archived Video

International Journal of Computer Vision
Perspective 3-D euclidean reconstruction with varying camera parameters

IEEE Transactions on Circuits and Systems for Video Technology
The self-referenced DLR 3D-modeler

IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Recursive estimation of motion and a scene model with a two-camera system of divergent view

Pattern Recognition
A robust approach for 3D cars reconstruction

SCIA'07 Proceedings of the 15th Scandinavian conference on Image analysis
Supporting structure from motion with a 3D-range-camera

SCIA'07 Proceedings of the 15th Scandinavian conference on Image analysis
Calibration of a multi-camera rig from non-overlapping views

Proceedings of the 29th DAGM conference on Pattern recognition
An analysis-by-synthesis camera tracking approach based on free-form surfaces

Proceedings of the 29th DAGM conference on Pattern recognition
Extraction of 3D unfoliaged trees from image sequences via a generative statistical approach

Proceedings of the 29th DAGM conference on Pattern recognition
Joint radiometric calibration and feature tracking system with an application to stereo

Computer Vision and Image Understanding
Model-assisted 3D face reconstruction from video

AMFG'07 Proceedings of the 3rd international conference on Analysis and modeling of faces and gestures
Descriptor-free smooth feature-point matching for images separated by small/mid baselines

ACIVS'07 Proceedings of the 9th international conference on Advanced concepts for intelligent vision systems
Unstructured video-based rendering: interactive exploration of casually captured videos

ACM SIGGRAPH 2010 papers
Automated scene-specific selection of feature detectors for 3D face reconstruction

ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part I
Evaluating multiview reconstruction

ICVS'08 Proceedings of the 6th international conference on Computer vision systems
Robust feature correspondences from a large set of unsorted wide baseline images

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Understanding transit scenes: a survey on human behavior-recognition algorithms

IEEE Transactions on Intelligent Transportation Systems
Combining monoSLAM with object recognition for scene augmentation using a wearable camera

Image and Vision Computing
Exploiting loops in the graph of trifocal tensors for calibrating a network of cameras

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part II
Video-object segmentation and 3D-trajectory estimation for monocular video sequences

Image and Vision Computing
Automatic scan registration using 3D linear and planar features

3D Research
DECHO—a framework for the digital exploration of cultural heritage objects

Journal on Computing and Cultural Heritage (JOCCH)
A Generic Error Model and Its Application to Automatic 3D Modeling of Scenes Using a Catadioptric Camera

International Journal of Computer Vision
Closed form solution for the scale ambiguity problem in monocular visual odometry

ICIRA'10 Proceedings of the Third international conference on Intelligent robotics and applications - Volume Part I
Bivariate feature localization for SIFT assuming a Gaussian feature shape

ISVC'10 Proceedings of the 6th international conference on Advances in visual computing - Volume Part I
Robust wide baseline scene alignment based on 3D viewpoint normalization

ISVC'10 Proceedings of the 6th international conference on Advances in visual computing - Volume Part I
Single viewpoint model completion of symmetric objects for digital inspection

Computer Vision and Image Understanding
The application of vision algorithms to visual effects production

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part I
Motion capture from body-mounted cameras

ACM SIGGRAPH 2011 papers
Approximate and SQP two view triangulation

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
Modeling dynamic scenes recorded with freely moving cameras

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
3D video and free viewpoint video-From capture to display

Pattern Recognition
Insitu: sketching architectural designs in context

Proceedings of the 2011 SIGGRAPH Asia Conference
Dense 3D reconstruction of symmetric scenes from a single image

DAGM'11 Proceedings of the 33rd international conference on Pattern recognition
Real-time camera tracking using a global localization scheme

ACCV'10 Proceedings of the 2010 international conference on Computer vision - Volume part II
Feature trajectory retrieval with application to accurate structure and motion recovery

ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part I
Non-parametric sequential frame decimation for scene reconstruction in low-memory streaming environments

ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part I
A public system for image based 3D model generation

MIRAGE'11 Proceedings of the 5th international conference on Computer vision/computer graphics collaboration techniques
Large-scale, dense city reconstruction from user-contributed photos

Computer Vision and Image Understanding
Scene reconstruction and visualization from internet photo collections

Scene reconstruction and visualization from internet photo collections
Robust feature representation for efficient camera registration

DAGM'06 Proceedings of the 28th conference on Pattern Recognition
Accurate 3d structure measurements from two uncalibrated views

ACIVS'06 Proceedings of the 8th international conference on Advanced Concepts For Intelligent Vision Systems
Robust linear auto-calibration of a moving camera from image sequences

ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part II
Mesh optimisation using edge information in feature-based surface reconstruction

ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part I
Automatic camera calibration and scene reconstruction with scale-invariant features

ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part I
On Camera Calibration with Linear Programming and Loop Constraint Linearization

International Journal of Computer Vision
Two stages stereo dense matching algorithm for 3d skin micro-surface reconstruction

MMM'10 Proceedings of the 16th international conference on Advances in Multimedia Modeling
A dynamic programming approach to maximizing tracks for structure from motion

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part II
A harris-like scale invariant feature detector

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part II
3D reconstruction and video-based rendering of casually captured videos

Proceedings of the 2010 international conference on Video Processing and Computational Video
Ray divergence-based bundle adjustment conditioning for multi-view stereo

PSIVT'11 Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part I
Recovering depth map from video with moving objects

PSIVT'11 Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part II
Research on a three-dimensional reconstruction method based on the feature matching algorithm of a scale-invariant feature transform

Mathematical and Computer Modelling: An International Journal
A semi-interactive panorama based 3D reconstruction framework for indoor scenes

Computer Vision and Image Understanding
Constructing the virtual Jing-Hang Grand Canal with onto-draw

Expert Systems with Applications: An International Journal
Hessian-Based Affine Adaptation of Salient Local Image Features

Journal of Mathematical Imaging and Vision
Structure from motion based approaches to 3d reconstruction in minimal invasive laparoscopy

ICIAR'12 Proceedings of the 9th international conference on Image Analysis and Recognition - Volume Part II
Shape capture assisted by traditional tools

VAST'07 Proceedings of the 8th International conference on Virtual Reality, Archaeology and Intelligent Cultural Heritage
Rapid synchronous acquisition of geometry and appearance of cultural heritage artefacts

VAST'05 Proceedings of the 6th International conference on Virtual Reality, Archaeology and Intelligent Cultural Heritage
As time flies by: mixed image and model-based rendering of an historical landscape from helicopter images

VAST'04 Proceedings of the 5th International conference on Virtual Reality, Archaeology and Intelligent Cultural Heritage
Interactive remote exploration of massive cityscapes

VAST'09 Proceedings of the 10th International conference on Virtual Reality, Archaeology and Cultural Heritage
Depth estimation for semi-automatic 2D to 3D conversion

Proceedings of the 20th ACM international conference on Multimedia
Dense 3d reconstruction from wide baseline image sets

Proceedings of the 15th international conference on Theoretical Foundations of Computer Vision: outdoor and large-scale real-world scene analysis
Tracking feature points in uncalibrated images with radial distortion

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Video enhancement leveraging high-quality depth maps

Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
Three-Dimensional virtual models for better comprehension of architectural heritage construction techniques and its maintenance over time

EuroMed'12 Proceedings of the 4th international conference on Progress in Cultural Heritage Preservation
A memory-efficient kinectfusion using octree

CVM'12 Proceedings of the First international conference on Computational Visual Media
A multi-stage linear approach to structure from motion

ECCV'10 Proceedings of the 11th European conference on Trends and Topics in Computer Vision - Volume Part II
Stratified Generalized Procrustes Analysis

International Journal of Computer Vision
Octree-based fusion for realtime 3D reconstruction

Graphical Models
Dense scene reconstruction with points of interest

ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Scalable real-time volumetric surface reconstruction

ACM Transactions on Graphics (TOG) - SIGGRAPH 2013 Conference Proceedings
Optimized selection of key frames for monocular videogrammetric surveying of civil infrastructure

Advanced Engineering Informatics
Learning object appearance from occlusions using structure and motion recovery

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Sequential reconstruction segment-wise feature track and structure updating based on parallax paths

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
Exploring high-level plane primitives for indoor 3d reconstruction with a hand-held RGB-D camera

ACCV'12 Proceedings of the 11th international conference on Computer Vision - Volume 2
Object detection, shape recovery, and 3D modelling by depth-encoded hough voting

Computer Vision and Image Understanding
Lumitrack: low cost, high precision, high speed tracking with projected m-sequences

Proceedings of the 26th annual ACM symposium on User interface software and technology
Multi-view dense 3D modelling of untextured objects from a moving projector-cameras system

Machine Vision and Applications
Evaluation of two-view geometry methods with automatic ground-truth generation

Image and Vision Computing
Efficient keyframe-based real-time camera tracking

Computer Vision and Image Understanding
A Simple Prior-Free Method for Non-rigid Structure-from-Motion Factorization

International Journal of Computer Vision

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper a complete system to build visual models from camera images is presented. The system can deal with uncalibrated image sequences acquired with a hand-held camera. Based on tracked or matched features the relations between multiple views are computed. From this both the structure of the scene and the motion of the camera are retrieved. The ambiguity on the reconstruction is restricted from projective to metric through self-calibration. A flexible multi-view stereo matching scheme is used to obtain a dense estimation of the surface geometry. From the computed data different types of visual models are constructed. Besides the traditional geometry- and image-based approaches, a combined approach with view-dependent geometry and texture is presented. As an application fusion of real and virtual scenes is also shown.