Exploring the similarities of neighboring spatiotemporal points for action pair matching

  • Authors:
  • Irene Kotsia;Ioannis Patras

  • Affiliations:
  • School of Electronic Engineering and Computer Science, Queen Mary University of London, UK;School of Electronic Engineering and Computer Science, Queen Mary University of London, UK

  • Venue:
  • ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part III
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present a novel similarity measure between two image sequences, that is a)robust to different viewpoints and recording conditions (illumination variations and clothing) b)robust to geometric transformations (translation, scale and rotation transformations) and c)invariant to the number of frames of the image sequence as well as of its time scaling. More precisely, we create a similarity measure that exploits the underlying relationships among neighborhoods of detected spatiotemporal points in a frame of an image sequence. We find the space in which the similarities of neighboring spatiotemporal points lie in, and map it to another space of smaller dimensionality. In the new space the projected similarities are of fixed dimensionality, depending on the number of neighbors we have considered. We use the information about that newly extracted space to define a novel similarity measure between two image sequences and create in that way a similarity vector that can be used as an input to a classifier. We apply the proposed similarity measure to the 'action pair matching' problem, in which we try to decide whether two action image sequences contain the same action or not. Experiments conducted using the Action Similarity Labeling (ASLAN) dataset verify the superiority of the proposed method over state of the art techniques in terms of accuracy rate.