Eyes from Eyes: New Cameras for Structure from Motion

  • Authors:
  • Jan Neumann;Cornelia Fermuller;Yiannis Aloimonos

  • Affiliations:
  • -;-;-

  • Venue:
  • OMNIVIS '02 Proceedings of the Third Workshop on Omnidirectional Vision
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

We investigate the relationship between camera design and the problemof recovering the motion and structure of a scene from video data.The visual information thatcould possiblybe obtainedis described by the plenoptic function. A camera can be viewed as adevice thatcapturesa subset of this function, that is, it measures some of thelight rays insome part of the space. The information contained in the subsetdetermineshow difficult it is to solve subsequent interpretation processes.By examining the differential structure of the time varying plenopticfunctionwe relate different known and new camera modelsto the spatio-temporal structure of the observed scene.This allows us to define a hierarchy of camera designs, where the orderisdetermined by the stability and complexity of the computations necessarytoestimatestructure and motion. At the low end of this hierarchyis the standard planar pinhole camera for which the structure frommotion problem isnon-linear and ill-posed. At the high end is a new camera, which wecall the full field of view polydioptric camera, for which theproblemis linearand stable. In between are multiple-view cameras with large fields ofview whichwe have built, as well as catadioptric panoramic sensors and otheromni-directional cameras.We develop design suggestions for the polydioptric camera, and based uponthis new design we propose alinearalgorithm for ego-motion estimation, which in essencecombinesdifferential motion estimationwith differential stereo.