Recognizing actions across cameras by exploring the correlated subspace

  • Authors:
  • Chun-Hao Huang;Yi-Ren Yeh;Yu-Chiang Frank Wang

  • Affiliations:
  • Research Center for IT Innovation, Academia Sinica, Taipei, Taiwan;Research Center for IT Innovation, Academia Sinica, Taipei, Taiwan;Research Center for IT Innovation, Academia Sinica, Taipei, Taiwan

  • Venue:
  • ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part I
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a novel transfer learning approach to cross-camera action recognition. Inspired by canonical correlation analysis (CCA), we first extract the spatio-temporal visual words from videos captured at different views, and derive a correlation subspace as a joint representation for different bag-of-words models at different views. Different from prior CCA-based approaches which simply train standard classifiers such as SVM in the resulting subspace, we explore the domain transfer ability of CCA in the correlation subspace, in which each dimension has a different capability in correlating source and target data. In our work, we propose a novel SVM with a correlation regularizer which incorporates such ability into the design of the SVM. Experiments on the IXMAS dataset verify the effectiveness of our method, which is shown to outperform state-of-the-art transfer learning approaches without taking such domain transfer ability into consideration.