Exploiting inter-frame correlation for fast video to reference image alignment

  • Authors:

  • Arif Mahmood;Sohaib Khan

  • Affiliations:

  • Department of Computer Science, Lahore University of Management Sciences, Lahore, Pakistan;Department of Computer Science, Lahore University of Management Sciences, Lahore, Pakistan

  • Venue:
  • ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Strong temporal correlation between adjacent frames of a video signal has been successfully exploited in standard video compression algorithms. In this work, we show that the temporal correlation in a video signal can also be used for fast video to reference image alignment. To this end, we first divide the input video sequence into groups of pictures (GOPs). Then for each GOP, only one frame is completely correlated with the reference image, while for the remaining frames, upper and lower bounds on the correlation coefficient (ρ) are calculated. These newly proposed bounds are significantly tighter than the existing Cauchy-Schwartz inequality based bounds on ρ. These bounds are used to eliminate majority of the search locations and thus resulting in significant speedup, without effecting the value or location of the global maxima. In our experiments, up to 80% search locations are found to be eliminated and the speedup is up to five times the FFT based implementation and up to seven times the spatial domain techniques.