A Correlation-Relaxation-Labeling Framework for Computing Optical Flow - Template Matching from a New Perspective

  • Authors:
  • Qing X. Wu

  • Affiliations:
  • -

  • Venue:
  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • Year:
  • 1995

Quantified Score

Hi-index 0.15

Visualization

Abstract

Optical flow estimation is discussed based on a model for time-varying images more general than that implied in the work of Horn and Schunk [21]. The emphasis is on applications where low contrast imagery, non-rigid or evolving object patterns movement, as well as large interframe displacements are encountered. Template matching is identified as having advantages over point correspondence and the gradient-based approach in dealing with such applications. The two fundamental uncertainties in feature matching procedures, whether it is template matching or feature point correspondences, are discussed. Correlation template matching procedures are established based on likelihood measurement. A new method for determining optical flow is developed by combining template matching and relaxation labeling. In this method, a number of candidate displacements for each template and their respective likelihood measures are first determined. Then, relaxation labeling is employed to iteratively update each candidate驴s likelihood by requiring smoothness within a motion field. Real cloud images taken from meteorological satellites are used to test the usefulness of this method. It is shown in this application that the new method can deal effectively with the uncertainty of multiple peak (multi-modal) correlation surfaces encountered in template matching. The results show significant improvement when compared to that of the maximum cross correlation (MCC), which has been operationally used for cloud tracking, and to that of the method of Barnard and Thompson, which estimates displacements based on combining point correspondences with relaxation labeling.