Temporal synchronization of non-overlapping videos using known object motion

  • Authors:

  • Darlan N. Brito;Flávio L. C. Pádua;Guilherme A. S. Pereira;Rodrigo L. Carceroni

  • Affiliations:

  • Department of Computing, Centro Federal de Educação Tecnológica de Minas Gerais, Av. Amazonas, 7675, 30510-000 BH, MG, Brazil;Department of Computing, Centro Federal de Educação Tecnológica de Minas Gerais, Av. Amazonas, 7675, 30510-000 BH, MG, Brazil;Department of Electrical Engineering, Universidade Federal de Minas Gerais, Av. Antônio Carlos, 6627, 31270-010 BH, MG, Brazil;Department of Computer Science, Universidade Federal de Minas Gerais, Av. Antônio Carlos, 6627, 31270-010 BH, MG, Brazil

  • Venue:
  • Pattern Recognition Letters
  • Year:
  • 2011

Quantified Score

Hi-index 0.10

Visualization

Abstract

This paper presents a robust technique for temporally aligning multiple video sequences that have no spatial overlap between their fields of view. It is assumed that (i) a moving target with known trajectory is viewed by all cameras at non-overlapping periods in time, (ii) the target trajectory is estimated with a limited error at a constant sampling rate, and (iii) the sequences are recorded by stationary cameras with constant frame rates and fixed intrinsic and extrinsic parameters. The proposed approach reduces the problem of synchronizing N non-overlapping sequences to the problem of robustly estimating a single line from a set of appropriately-generated points in R^N^+^1. This line describes all temporal relations between the N sequences and the moving target. Our technique can handle arbitrarily-large misalignments between the sequences and does not require any a priori information about their temporal relations. Experimental results with real-world and synthetic sequences demonstrate that our method can accurately align the videos.