Variational inference with graph regularization for image annotation

  • Authors:
  • Yuanlong Shao;Yuan Zhou;Deng Cai

  • Affiliations:
  • State Key Laboratory of CAD&CG, Zhejiang University, Zhejiang, P. R., China;State Key Laboratory of CAD&CG, Zhejiang University, Zhejiang, P. R., China;State Key Laboratory of CAD&CG, Zhejiang University, Zhejiang, P. R., China

  • Venue:
  • ACM Transactions on Intelligent Systems and Technology (TIST)
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Image annotation is a typical area where there are multiple types of attributes associated with each individual image. In order to achieve better performance, it is important to develop effective modeling by utilizing prior knowledge. In this article, we extend the graph regularization approaches to a more general case where the regularization is imposed on the factorized variational distributions, instead of posterior distributions implicitly involved in EM-like algorithms. In this way, the problem modeling can be more flexible, and we can choose any factor in the problem domain to impose graph regularization wherever there are similarity constraints among the instances. We formulate the problem formally and show its geometrical background in manifold learning. We also design two practically effective algorithms and analyze their properties such as the convergence. Finally, we apply our approach to image annotation and show the performance improvement of our algorithm.