Multi-instance multi-label image classification: A neural approach

Authors:
Zenghai Chen;Zheru Chi;Hong Fu;Dagan Feng
Affiliations:
Centre for Multimedia Signal Processing, Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong;Centre for Multimedia Signal Processing, Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong;Centre for Multimedia Signal Processing, Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong and Department of Computer Science ...;Centre for Multimedia Signal Processing, Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong and School of Information Technolo ...
Venue:
Neurocomputing
Year:
2013

Citing 24
Cited 0

Unsupervised Segmentation of Color-Texture Regions in Images and Video

IEEE Transactions on Pattern Analysis and Machine Intelligence
Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Efficient Learning in Adaptive Processing of Data Structures

Neural Processing Letters
Normalized Cuts and Image Segmentation

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Image Categorization by Learning and Reasoning with Regions

The Journal of Machine Learning Research
Genetic Evolution Processing of Classification

IEEE Transactions on Knowledge and Data Engineering
Histograms of Oriented Gradients for Human Detection

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
The relationship between Precision-Recall and ROC curves

ICML '06 Proceedings of the 23rd international conference on Machine learning
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Correlated Label Propagation with Application to Multi-label Learning

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
MILES: Multiple-Instance Learning via Embedded Instance Selection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Attention-driven image interpretation with application to image retrieval

Pattern Recognition
Image annotation via graph learning

Pattern Recognition
Neural network ensemble with probabilistic fusion and its application to gait recognition

Neurocomputing
Letters: MIMLRBF: RBF neural networks for multi-instance multi-label learning

Neurocomputing
Drosophila gene expression pattern annotation through multi-instance multi-label learning

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Recognition of attentive objects with a concept association network for image annotation

Pattern Recognition
Human tracking using convolutional neural networks

IEEE Transactions on Neural Networks
Hebbian-based neural networks for bottom-up visual attention and its applications to ship detection in SAR images

Neurocomputing
Remote sensing image classification based on neural network ensemble algorithm

Neurocomputing
A probabilistic interpretation of precision, recall and F-score, with implication for evaluation

ECIR'05 Proceedings of the 27th European conference on Advances in Information Retrieval Research
An extended one-versus-rest support vector machine for multi-label classification

Neurocomputing
Combining visual attention model with multi-instance learning for tag ranking

Neurocomputing
An improved algorithm for learning long-term dependency problems in adaptive processing of data structures

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.01

Visualization

Abstract

In this paper, a multi-instance multi-label algorithm based on neural networks is proposed for image classification. The proposed algorithm, termed multi-instance multi-label neural network (MIMLNN), consists of two stages of MultiLayer Perceptrons (MLP). For multi-instance multi-label image classification, all the regional features are fed to the first-stage MLP, with one MLP copy processing one image region. After that, the MLP in the second stage incorporates the outputs of the first-stage MLPs to produce the final labels for the input image. The first-stage MLP is expected to model the relationship between regions and labels, while the second-stage MLP aims at capturing the label correlation for classification refinement. Error Back-Propagation (BP) approach is adopted to tune the parameters of MIMLNN. In view of that traditional gradient descent algorithm suffers from long-term dependency problem, a refined BP algorithm named Rprop is extended to effectively train MIMLNN. The experiments are conducted on a synthetic dataset and the Corel dataset. Experimental results demonstrate the superior performance of MIMLNN comparing with state-of-the-art algorithms for multi-instance multi-label image classification.