Intelligent Robot Vision Sensors in VLSI

  • Authors:
  • Ralph Etienne-Cummings

  • Affiliations:
  • Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, MD 21218. etienne@ece.jhu.edu

  • Venue:
  • Autonomous Robots
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

Traditional approaches for solving real-world problemsusing computer vision have depended heavily on CCD cameras andworkstations. As the computation power of workstations doubles every1.5 years, they are now better able to handle the large amount ofdata presented by the cameras; yet real-time solutions for physicalinteraction with the real-world continues to be very hard, andrelegated to large and expensive systems. Our approach attempts tosolve this problem by using computational sensors andsmall/inexpensive embedded processors. The computational sensors arecustom designed to reduce the amount of data collected, to extractonly relevant information and to present this information to thesimple processor, microcontrollers (μCs) or DSPs, in a formatwhich reduces post-processing latency. Consequently, thepost-processors are required to perform only high level computationon features rather than data. These systems are applied to problemssuch as target acquisition and tracking for image stabilization andautonomous data driven autonavigation for mobile robots. We presentan example of a system that uses a pair of computational sensors anda μC to solve a toy autonavigation problem.The computational sensors, however, have wide applications in manyproblems that require image preprocessing such as edge detection,motion detection, centroid localization and other spatiotemporalprocessing. This paper also presents a general-purpose computationalsensor capable of extracting many visual information components atthe focal plane.