3D Target Scale Estimation and Target Feature Separation for Size Preserving Tracking in PTZ Video

  • Authors:
  • Yi Yao;Besma Abidi;Mongi Abidi

  • Affiliations:
  • Imaging, Robotics, and Intelligent Systems Laboratory, Department of Electrical & Computer Engineering, University of Tennessee, Knoxville, USA 37996;Imaging, Robotics, and Intelligent Systems Laboratory, Department of Electrical & Computer Engineering, University of Tennessee, Knoxville, USA 37996;Imaging, Robotics, and Intelligent Systems Laboratory, Department of Electrical & Computer Engineering, University of Tennessee, Knoxville, USA 37996

  • Venue:
  • International Journal of Computer Vision
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

To achieve size preserving tracking, in addition to controlling the camera's pan and tilt motions to keep the object of interest in the camera's field of view (FOV), the camera's focal length is adjusted automatically to compensate for the changes in the target's image size caused by the relative motion between the camera and the target. The estimation accuracy of these changes determines the effectiveness of the resulting zoom control. The existing method of choice for real-time target scale estimation applies structure from motion (SFM) based on the weak perspective projection model. In this paper we propose a target scale estimation algorithm with a linear solution based on the more advanced paraperspective projection model, which improves the accuracy of scale estimation by considering center offset. Another key issue in SFM based algorithms is the separation of target and background features, especially when composite camera (pan/tilt/zoom) and target motions are involved. This paper designs a fast target feature separation/grouping algorithm, the 3D affine shape method. The resulting separation automatically adapts to the target's 3D geometry and motion and is able to accommodate a large amount of off-plane rotation, which most existing separation/grouping algorithms find difficult to achieve. Experimental results illustrate the effectiveness of the proposed scale estimation and feature separation algorithms in tracking translating and rotating objects with a PTZ camera while preserving their sizes. In comparison with the leading size preserving tracking algorithm described by Tordoff and Murray, our algorithm is able to reduce the cumulative tracking error significantly from 17.4% to 3.3%.