Spatio-Temporal Stereo Using Multi-Resolution Subdivision Surfaces

Authors:
Jan Neumann;Yiannis Aloimonos
Affiliations:
Center for Automation Research, University of Maryland, College Park, MD 20742-3275, USA. jneumann@cfar.umd.edu;Center for Automation Research, University of Maryland, College Park, MD 20742-3275, USA. yiannis@cfar.umd.edu
Venue:
International Journal of Computer Vision
Year:
2002

Citing 15
Cited 16

Piecewise smooth surface reconstruction

SIGGRAPH '94 Proceedings of the 21st annual conference on Computer graphics and interactive techniques
A signal processing approach to fair surface design

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Model-based joint motion and structure estimation from stereo images

Computer Vision and Image Understanding
Interactive multiresolution mesh editing

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Coding, Analysis, Interpretation, and Recognition of Facial Expressions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Three-Dimensional Human Body Model Acquisition from Multiple Views

International Journal of Computer Vision
Photorealistic Scene Reconstruction by Voxel Coloring

International Journal of Computer Vision
Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Regularized Bundle-Adjustment to Model Heads from Image Sequences without Calibration Data

International Journal of Computer Vision
Tracking and modeling people in video sequences

Computer Vision and Image Understanding - Modeling people toward vision-based underatanding of a person's shape, appearance, and movement
Robot Vision

Robot Vision
A Theory of Shape by Space Carving

International Journal of Computer Vision - Special issue on Genomic Signal Processing
The Visual Hull Concept for Silhouette-Based Image Understanding

IEEE Transactions on Pattern Analysis and Machine Intelligence
Complete Dense Stereovision Using Level Set Methods

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume I - Volume I
Three-Dimensional Scene Flow

ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2

Shape from Contours and Multiple Stereo " A Hierarchical, Mesh-Based Approach

CRV '04 Proceedings of the 1st Canadian Conference on Computer and Robot Vision
A hierarchy of cameras for 3D photography

Computer Vision and Image Understanding - Model-based and image-based 3D scene representation for interactive visalization
Multi-View Stereo Reconstruction and Scene Flow Estimation with a Global Image-Based Matching Score

International Journal of Computer Vision
Real-time joint disparity and disparity flow estimation on programmable graphics hardware

Computer Vision and Image Understanding
SNR and temporal scalable coding of 3-D mesh sequences using singular value decomposition

Journal of Visual Communication and Image Representation
A globally optimal approach for 3D elastic motion estimation from stereo sequences

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Feature-assisted dense spatio-temporal reconstruction from binocular sequences

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV
Globally optimal spatio-temporal reconstruction from cluttered videos

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
Dense and accurate spatio-temporal multi-view stereovision

ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part II
Go with the flow: hand trajectories in 3d via clustered scene flow

ICIAR'12 Proceedings of the 9th international conference on Image Analysis and Recognition - Volume Part I
A tensor voting approach for multi-view 3d scene flow estimation and refinement

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
Towards optimal non-rigid surface tracking

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part IV
On the evaluation of scene flow estimation

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume 2
Multi-view Scene Flow Estimation: A View Centered Variational Approach

International Journal of Computer Vision
Global Non-rigid Alignment of Surface Sequences

International Journal of Computer Vision
Local scene flow by tracking in intensity and depth

Journal of Visual Communication and Image Representation

Quantified Score

Hi-index	0.02

Visualization

Abstract

We present a method to automatically extract spatio-temporal descriptions of moving objects from synchronized and calibrated multi-view sequences. The object is modeled by a time-varying multi-resolution subdivision surface that is fitted to the image data using spatio-temporal multi-view stereo information, as well as contour constraints. The stereo data is utilized by computing the normalized correlation between corresponding spatio-temporal image trajectories of surface patches, while the contour information is determined using incremental segmentation of the viewing volume into object and background. We globally optimize the shape of the spatio-temporal surface in a coarse-to-fine manner using the multi-resolution structure of the subdivision mesh. The method presented incorporates the available image information in a unified framework and automatically reconstructs accurate spatio-temporal representations of complex non-rigidly moving objects.