Semiconducting bilinear deep learning for incomplete image recognition

  • Authors:
  • Sheng-hua Zhong;Yan Liu;Fu-lai Chung;Gangshan Wu

  • Affiliations:
  • The Hong Kong Polytechnic University, Hong Kong, P. R. China;The Hong Kong Polytechnic University, Hong Kong, P. R. China;The Hong Kong Polytechnic University, Hong Kong, P. R. China;Nanjing University, Nanjing, P. R. China

  • Venue:
  • Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Image recognition with incomplete data is a well-known hard problem in multimedia content analysis. This paper proposes a novel deep learning technique called semiconducting bilinear deep belief networks (SBDBN) by referencing human's visual cortex and intelligent perception. Inheriting from deep models, SBDBN simulates the laminar structure of human's cerebral cortex and the neural loop in human's visual areas. To address the special difficulties of image recognition with incomplete data, we design a novel second-order deep architecture with semiconducting restricted boltzmann machines. Moreover, two peaks activation of human's perception is implemented by three learning stages of semiconducting bilinear discriminant initialization, greedy layer-wise reconstruction, and global fine-tuning. Owing to exploiting the embedding information according to the reliable features rather than any completion of missing features, the proposed SBDBN has demonstrated outstanding recognition ability on two standard datasets and one constructed dataset, comparing with both incomplete image recognition techniques and existing deep learning models.