Human action recognition using extreme learning machine based on visual vocabularies

  • Authors:
  • Rashid Minhas;Aryaz Baradarani;Sepideh Seifzadeh;Q. M. Jonathan Wu

  • Affiliations:
  • Department of Electrical and Computer Engineering, University of Windsor, Ontario, Canada N9B 3P4;Department of Electrical and Computer Engineering, University of Windsor, Ontario, Canada N9B 3P4;School of Computer Science, University of Windsor, Ontario, Canada N9B 3P4;Department of Electrical and Computer Engineering, University of Windsor, Ontario, Canada N9B 3P4

  • Venue:
  • Neurocomputing
  • Year:
  • 2010

Quantified Score

Hi-index 0.01

Visualization

Abstract

This paper introduces a novel recognition framework for human actions using hybrid features. The hybrid features consist of spatio-temporal and local static features extracted using motion-selectivity attribute of 3D dual-tree complex wavelet transform (3D DT-CWT) and affine SIFT local image detector, respectively. The proposed model offers two core advantages: (1) the framework is significantly faster than traditional approaches due to volumetric processing of images as a '3D box of data' instead of a frame by frame analysis, (2) rich representation of human actions in terms of reduction in artifacts in view of the promising properties of our recently designed full symmetry complex filter banks with better directionality and shift-invariance properties. No assumptions about scene background, location, objects of interest, or point of view information are made whereas bidirectional two-dimensional PCA (2D-PCA) is employed for dimensionality reduction which offers enhanced capabilities to preserve structure and correlation amongst neighborhood pixels of a video frame.