View independent recognition of human-vehicle interactions using 3-D models

  • Authors:

  • Jong T. Lee;M. S. Ryoo;J. K. Aggarwal

  • Affiliations:

  • Computer & Vision Research Center, Department of ECE, The University of Texas at Austin;Computer & Vision Research Center, Department of ECE, The University of Texas at Austin and Robot Research Department, Electronics and Telecommunications Research Institute, Korea;Computer & Vision Research Center, Department of ECE, The University of Texas at Austin

  • Venue:
  • WMVC'09 Proceedings of the 2009 international conference on Motion and video computing
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Recognition of human-vehicle interactions is a challenging problem. The occlusion by vehicles and motion of humans contribute to the difficulty. In this paper, we present a novel approach for the view independent recognition of human-vehicle interactions. The shape based matching of synthetic 3-D vehicle models is used for accurate localization of vehicles and for the specification of regions-of-interest (e.g. doors). In the proposed method, the system transforms the optical flow field based on the position of doors and the direction of a vehicle. This enables the system to extract view-independent features. Histogram of oriented optical flow (HOOF) and histogram of oriented gradient (HOG) characterize the optical flow and gradient, respectively. A support vector machine (SVM) classifier is trained for these view-independent features. Consequently, the system recognizes the interactions of a person entering a vehicle and getting out of a vehicle. Our method is applied to a dataset of human-vehicle interactions taken from 8 different viewpoints, composed of 120 video clips. The experimental results show that the system recognizes sequences of complex human-vehicle interactions with a high recognition rate of 86 %.