Multi-feature canonical correlation analysis for face photo-sketch image retrieval

  • Authors:
  • Dihong Gong;Zhifeng Li;Jianzhuang Liu;Yu Qiao

  • Affiliations:
  • Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shen Zhen, China;Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shen Zhen, China;Media Lab, Huawei Technologies Co. Ltd., China, Shen Zhen, China;Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shen Zhen, China

  • Venue:
  • Proceedings of the 21st ACM international conference on Multimedia
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Automatic face photo-sketch image retrieval has attracted great attention in recent years due to its important applications in real life. The major difficulty in automatic face photo-sketch image retrieval lies in the fact that there exists great discrepancy between the different image modalities (photo and sketch). In order to reduce such discrepancy and improve the performance of automatic face photo-sketch image retrieval, we propose a new framework called multi-feature canonical correlation analysis (MCCA) to effectively address this problem. The MCCA is an extension and improvement of the canonical correlation analysis (CCA) algorithmusing multiple features combined with two different random sampling methods in feature space and sample space. In this framework, we first represent each photo or sketch using a patch-based local feature representation scheme, in which histograms of oriented gradients (HOG) and multi-scale local binary pattern (MLBP) serve as the local descriptors. Canonical correlation analysis (CCA) is then performed on a collection of random subspaces to construct an ensemble of classifiers for photo-sketch image retrieval. Extensive experiments on two public-domain face photo-sketch datasets (CUFS and CUFSF) clearly show that the proposed approach obtains a substantial improvement over the state-of-the-art.