Effective automatic image annotation via integrated discriminative and generative models

Authors:
Mei Wang;Xiaoling Xia;Jiajin Le;Xiangdong Zhou
Affiliations:
-;-;-;-
Venue:
Information Sciences: an International Journal
Year:
2014

Citing 36
Cited 0

Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Hierarchical Text Classification and Evaluation

ICDM '01 Proceedings of the 2001 IEEE International Conference on Data Mining
Automatic image annotation and retrieval using cross-media relevance models

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
On image auto-annotation with latent space models

MULTIMEDIA '03 Proceedings of the eleventh ACM international conference on Multimedia
A study of smoothing methods for language models applied to information retrieval

ACM Transactions on Information Systems (TOIS)
PLSA-based image auto-annotation: constraining the latent space

Proceedings of the 12th annual ACM international conference on Multimedia
Evaluating the impact of selection noise in community-based web search

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Semantic knowledge extraction and annotation for web images

Proceedings of the 13th annual ACM international conference on Multimedia
Principled Hybrids of Generative and Discriminative Models

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Region-based Image Annotation using Asymmetrical Support Vector Machine-based Multiple-Instance Learning

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
AnnoSearch: Image Auto-Annotation by Search

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
An adaptive graph model for automatic image annotation

MIR '06 Proceedings of the 8th ACM international workshop on Multimedia information retrieval
Automatic image annotation by incorporating feature hierarchy and boosting to scale up SVM classifiers

MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Supervised Learning of Semantic Classes for Image Annotation and Retrieval

IEEE Transactions on Pattern Analysis and Machine Intelligence
Maximum margin clustering made practical

Proceedings of the 24th international conference on Machine learning
Hierarchical classification for automatic image annotation

SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Topic segmentation with shared topic detection and alignment of multiple documents

SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Automatic image annotation by an iterative approach: incorporating keyword correlations and region matching

Proceedings of the 6th ACM international conference on Image and video retrieval
Towards optimal bag-of-features for object categorization and semantic video retrieval

Proceedings of the 6th ACM international conference on Image and video retrieval
Automatic image annotation via local multi-label classification

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
A New Baseline for Image Annotation

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part III
Graph-based semi-supervised learning with multiple labels

Journal of Visual Communication and Image Representation
Visual query suggestion: Towards capturing user intent in internet image search

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Multiple Bernoulli relevance models for image and video annotation

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Modeling continuous visual features for semantic image annotation and retrieval

Pattern Recognition Letters
LIBSVM: A library for support vector machines

ACM Transactions on Intelligent Systems and Technology (TIST)
Unsupervised Image Categorization by Hypergraph Partition

IEEE Transactions on Pattern Analysis and Machine Intelligence
A review on automatic image annotation techniques

Pattern Recognition
Bayesian learning of hierarchical multinomial mixture models of concepts for automatic image annotation

CIVR'06 Proceedings of the 5th international conference on Image and Video Retrieval
Semi-supervised learning for image annotation based on conditional random fields

CIVR'06 Proceedings of the 5th international conference on Image and Video Retrieval
Interactive Video Indexing With Statistical Active Learning

IEEE Transactions on Multimedia
HyDR-MI: A hybrid algorithm to reduce dimensionality in multiple instance learning

Information Sciences: an International Journal
An efficient two-stage framework for image annotation

Pattern Recognition
Image annotation by semi-supervised cross-domain learning with group sparsity

Journal of Visual Communication and Image Representation
A constraint propagation approach to structural model based image segmentation and recognition

Information Sciences: an International Journal

Quantified Score

Hi-index	0.07

Visualization

Abstract

In this paper, we present a novel image annotation method that leverages on the advantages of both generative and discriminative models. To label an image, we first identify a visual neighborhood in the training image set based on generative approach. Then, the neighborhood is refined by an optimal discriminative hyperplane tree classifier based on concept feature. The tree classifier is built according to a local topic hierarchy, which is adaptively constructed by exploiting the semantic contextual correlations of the corresponding visual neighborhood. Experiments conducted on the ECCV2002 and TRECVID 2005 benchmarks demonstrate the effectiveness and efficiency of the proposed method.