A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms
International Journal of Computer Vision
Spatio-Temporal Stereo Using Multi-Resolution Subdivision Surfaces
International Journal of Computer Vision
International Journal of Computer Vision
ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume I - Volume I
ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Dense Matching of Multiple Wide-baseline Views
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
IEEE Transactions on Pattern Analysis and Machine Intelligence
Efficient Belief Propagation for Early Vision
International Journal of Computer Vision
Edge-preserving Simultaneous Joint Motion-Disparity Estimation
ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 02
Multi-View Stereo Reconstruction and Scene Flow Estimation with a Global Image-Based Matching Score
International Journal of Computer Vision
Multi-scale 3D scene flow from binocular stereo sequences
Computer Vision and Image Understanding
A Convex Formulation of Continuous Multi-label Problems
ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part III
Efficient Dense Scene Flow from Sparse or Dense Stereo Data
ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Global Stereo Reconstruction under Second-Order Smoothness Priors
IEEE Transactions on Pattern Analysis and Machine Intelligence
High-accuracy stereo depth maps using structured light
CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Stereoscopic Scene Flow Computation for 3D Motion Understanding
International Journal of Computer Vision
Dense motion and disparity estimation via loopy belief propagation
ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part II
Dense and accurate spatio-temporal multi-view stereovision
ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part II
Go with the flow: hand trajectories in 3d via clustered scene flow
ICIAR'12 Proceedings of the 9th international conference on Image Analysis and Recognition - Volume Part I
| Hi-index | 0.00 |
We present a novel method for recovering the 3D structure and scene flow from calibrated multi-view sequences. We propose a 3D point cloud parametrization of the 3D structure and scene flow that allows us to directly estimate the desired unknowns. A unified global energy functional is proposed to incorporate the information from the available sequences and simultaneously recover both depth and scene flow. The functional enforces multi-view geometric consistency and imposes brightness constancy and piecewise smoothness assumptions directly on the 3D unknowns. It inherently handles the challenges of discontinuities, occlusions, and large displacements. The main contribution of this work is the fusion of a 3D representation and an advanced variational framework that directly uses the available multi-view information. This formulation allows us to advantageously bind the 3D unknowns in time and space. Different from optical flow and disparity, the proposed method results in a nonlinear mapping between the images' coordinates, thus giving rise to additional challenges in the optimization process. Our experiments on real and synthetic data demonstrate that the proposed method successfully recovers the 3D structure and scene flow despite the complicated nonconvex optimization problem.