Representing shape with a spatial pyramid kernel

Authors:
Anna Bosch;Andrew Zisserman;Xavier Munoz
Affiliations:
University of Girona, Girona, Spain;University of Oxford, Oxford, UK;University of Girona, Girona, Spain
Venue:
Proceedings of the 6th ACM international conference on Image and video retrieval
Year:
2007

Citing 20
Cited 137

Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm

IEEE Transactions on Pattern Analysis and Machine Intelligence
Shape-adapted smoothing in estimation of 3-D depth cues from affine distortions of local 2-D brightness structure

ECCV '94 Proceedings of the third European conference on Computer vision (vol. 1)
Learning Texture Discrimination Masks

IEEE Transactions on Pattern Analysis and Machine Intelligence
Indoor-Outdoor Image Classification

CAIVD '98 Proceedings of the 1998 International Workshop on Content-Based Access of Image and Video Databases (CAIVD '98)
Filtering Using a Tree-Based Estimator

ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Multiple kernel learning, conic duality, and the SMO algorithm

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories

CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 12 - Volume 12
Pedestrian Detection in Crowded Scenes

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Histograms of Oriented Gradients for Human Detection

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Contour-Based Learning for Object Detection

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
The Pyramid Match Kernel: Discriminative Classification with Sets of Image Features

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2
Nonstationary kernel combination

ICML '06 Proceedings of the 23rd international conference on Machine learning
Incremental learning of object detectors using a visual shape alphabet

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Multiclass Object Recognition with Sparse, Localized Features

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Using Dependent Regions for Object Categorization in a Generative Framework

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Local Features and Kernels for Classification of Texture and Object Categories: A Comprehensive Study

International Journal of Computer Vision
Scene classification via pLSA

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part IV

Multiple feature fusion by subspace learning

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
A comparison of color features for visual concept classification

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Discriminative cue integration for medical image annotation

Pattern Recognition Letters
A Multiple Kernel Learning Approach to Joint Multi-class Object Detection

Proceedings of the 30th DAGM symposium on Pattern Recognition
Boosting for Model-Based Data Clustering

Proceedings of the 30th DAGM symposium on Pattern Recognition
A string matching approach for visual retrieval and classification

MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Learning to Localize Objects with Structured Output Regression

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Shape Matching by Segmentation Averaging

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
An Integrated Method for Multiple Object Detection and Localization

ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing, Part II
EnsembleMatrix: interactive visualization to support machine learning with multiple classifiers

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multi-class image segmentation using conditional random fields and global classification

ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Leveraging large-scale weakly-tagged images to train inter-related classifiers for multi-label annotation

LS-MMRM '09 Proceedings of the First ACM workshop on Large-scale multimedia retrieval and mining
Kernel Methods in Computer Vision

Foundations and Trends® in Computer Graphics and Vision
A procedure of adaptive kernel combination with kernel-target alignment for object classification

Proceedings of the ACM International Conference on Image and Video Retrieval
Integrating visual and semantic contexts for topic network generation and word sense disambiguation

Proceedings of the ACM International Conference on Image and Video Retrieval
Spatial extensions to bag of visual words

Proceedings of the ACM International Conference on Image and Video Retrieval
Efficient Hypothesis Generation through Sub-categorization for Multiple Object Detection

ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part II
Object Detection and Localization in Clutter Range Images Using Edge Features

ISVC '09 Proceedings of the 5th International Symposium on Advances in Visual Computing: Part II
Spatial pyramids and two-layer stacking SVM classifiers for image categorization: a comparative study

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Facial-component-based bag of words and PHOG descriptor for facial expression recognition

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
Boosted forest for human detection

Proceedings of the First International Conference on Internet Multimedia Computing and Service
Discriminative human action recognition in the learned hierarchical manifold space

Image and Vision Computing
Gaussian Processes for Object Categorization

International Journal of Computer Vision
Structured max-margin learning for multi-label image annotation

Proceedings of the ACM International Conference on Image and Video Retrieval
Concept model-based unsupervised web image re-ranking

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
A novel feature extraction method using pyramid histogram of orientation gradients for smile recognition

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Track-based self-supervised classification of dynamic obstacles

Autonomous Robots
Entropy descriptor for image classification

Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Per-sample multiple kernel approach for visual concept learning

Journal on Image and Video Processing - Special issue on selected papers from multimedia modeling conference 2009
Nearest-neighbor classification using unlabeled data for real world image application

Proceedings of the international conference on Multimedia
Automatic key pose selection for 3D human action recognition

AMDO'10 Proceedings of the 6th international conference on Articulated motion and deformable objects
Scene categorization using boosted back-propagation neural networks

PCM'10 Proceedings of the 11th Pacific Rim conference on Advances in multimedia information processing: Part I
Duplication localization and segmentation

PCM'10 Proceedings of the 11th Pacific Rim conference on Advances in multimedia information processing: Part I
Maximum margin distance learning for dynamic texture recognition

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part II
Towards optimal naive bayes nearest neighbor

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Adapting visual category models to new domains

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Improving local descriptors by embedding global and local spatial information

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Active mask hierarchies for object detection

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
Image classification using super-vector coding of local image descriptors

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part V
Clustering complex data with group-dependent feature selection

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
An improved pyramid matching kernel

LSMS/ICSEE'10 Proceedings of the 2010 international conference on Life system modeling and and intelligent computing, and 2010 international conference on Intelligent computing for sustainable energy and environment: Part I
Recognizing human action from a far field of view

WMVC'09 Proceedings of the 2009 international conference on Motion and video computing
Computational TMA analysis and cell nucleus classification of renal cell carcinoma

Proceedings of the 32nd DAGM conference on Pattern recognition
One-shot learning of object categories using dependent Gaussian processes

Proceedings of the 32nd DAGM conference on Pattern recognition
An improved fusion method based on adaboost algorithm for semantic concept extraction

ICIMCS '10 Proceedings of the Second International Conference on Internet Multimedia Computing and Service
Boosted scene categorization approach by adjusting inner structures and outer weights of weak classifiers

MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part I
Snap2Read: automatic magazine capturing and analysis for adaptive mobile reading

MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II
One-class classification with gaussian processes

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part II
A hybrid supervised-unsupervised vocabulary generation algorithm for visual concept recognition

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
On feature combination and multiple kernel learning for object tracking

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
Pyramid center-symmetric local binary/trinary patterns for effective pedestrian detection

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV
Tag suggestion using visual content and social tag

Proceedings of the 5th International Conference on Ubiquitous Information Management and Communication
Spatial codebooks for image categorization

Proceedings of the 1st ACM International Conference on Multimedia Retrieval
Hypergraph with sampling for image retrieval

Pattern Recognition
Semantics extraction from images

Knowledge-driven multimedia information extraction and ontology evolution
Pyramid histograms of motion context with application to angiogram video classification

FIMH'11 Proceedings of the 6th international conference on Functional imaging and modeling of the heart
On importance of interactions and context in human action recognition: Nataliya,,Shapovalova

IbPRIA'11 Proceedings of the 5th Iberian conference on Pattern recognition and image analysis
Recent advances and trends in visual tracking: A review

Neurocomputing
Spectral clustering of ROIs for object discovery

DAGM'11 Proceedings of the 33rd international conference on Pattern recognition
Robust classification and semi-supervised object localization with Gaussian processes

DAGM'11 Proceedings of the 33rd international conference on Pattern recognition
A multiple Kernel learning algorithm for cell nucleus classification of renal cell carcinoma

ICIAP'11 Proceedings of the 16th international conference on Image analysis and processing: Part I
Localization of the Lumbar discs using machine learning and exact probabilistic inference

MICCAI'11 Proceedings of the 14th international conference on Medical image computing and computer-assisted intervention - Volume Part III
Evaluating feature combination in object classification

ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part II
Hybrid generative-discriminative nucleus classification of renal cell carcinoma

SIMBAD'11 Proceedings of the First international conference on Similarity-based pattern recognition
Combining data sources nonlinearly for cell nucleus classification of renal cell carcinoma

SIMBAD'11 Proceedings of the First international conference on Similarity-based pattern recognition
Offline signature verification and identification by hybrid features and Support Vector Machine

International Journal of Artificial Intelligence and Soft Computing
Comp2Watch: enhancing the mobile video browsing experience

IMMPD '11 Proceedings of the 2011 international ACM workshop on Interactive multimedia on mobile and portable devices
Renal cancer cell classification using generative embeddings and information theoretic kernels

PRIB'11 Proceedings of the 6th IAPR international conference on Pattern recognition in bioinformatics
Spectral Regression dimension reduction for multiple features facial image retrieval

International Journal of Biometrics
Discriminative compact pyramids for object and scene recognition

Pattern Recognition
Discovering class-specific informative patches and its application in landmark charaterization

MMM'10 Proceedings of the 16th international conference on Advances in Multimedia Modeling
Feature relationships hypergraph for multimodal recognition

ICONIP'11 Proceedings of the 18th international conference on Neural Information Processing - Volume Part I
A multiresolution framework for local similarity based image denoising

Pattern Recognition
Classification of vehicle type and make by combined features and random subspace ensemble

International Journal of Computational Vision and Robotics
Multi kernel learning with online-batch optimization

The Journal of Machine Learning Research
Object detection by admissible region search

AI'11 Proceedings of the 24th international conference on Advances in Artificial Intelligence
Modulating Shape Features by Color Attention for Object Recognition

International Journal of Computer Vision
An on-line learning method for face association in personal photo collection

Image and Vision Computing
Image representation for generic object recognition using higher-order local autocorrelation features on posterior probability images

Pattern Recognition
Two dimensional principal components of natural images and its application

Neurocomputing
Object Recognition by Sequential Figure-Ground Ranking

International Journal of Computer Vision
Nearest-neighbor method using multiple neighborhood similarities for social media data mining

Neurocomputing
Learning by expansion: Exploiting social media for image classification with few training examples

Neurocomputing
Spatial-Based feature for locating objects

ICIC'12 Proceedings of the 8th international conference on Intelligent Computing Theories and Applications
Compact and adaptive spatial pyramids for scene recognition

Image and Vision Computing
Point-context descriptor based region search for logo recognition

Proceedings of the 4th International Conference on Internet Multimedia Computing and Service
Leveraging high-level and low-level features for multimedia event detection

Proceedings of the 20th ACM international conference on Multimedia
Discovering informative social subgraphs and predicting pairwise relationships from group photos

Proceedings of the 20th ACM international conference on Multimedia
Supervised learning probabilistic Latent Semantic Analysis for human motion analysis

Neurocomputing
Locality constrained representation based classification with spatial pyramid patches

Neurocomputing
Combining information theoretic kernels with generative embeddings for classification

Neurocomputing
Topic based pose relevance learning in dance archives

Proceedings of the 21st ACM international conference on Information and knowledge management
Automatic classification of archaeological pottery sherds

Journal on Computing and Cultural Heritage (JOCCH)
PHOG-derived aesthetic measures applied to color photographs of artworks, natural scenes and objects

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part I
ISABoost: A weak classifier inner structure adjusting based AdaBoost algorithm-ISABoost based application in scene categorization

Neurocomputing
All smiles: automatic photo enhancement by facial expression analysis

Proceedings of the 9th European Conference on Visual Media Production
Classification of segmented objects through a multi-net approach

ANNPR'12 Proceedings of the 5th INNS IAPR TC 3 GIRPR conference on Artificial Neural Networks in Pattern Recognition
Novel color Gabor-LBP-PHOG (GLP) descriptors for object and scene image classification

Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing
Entropy based image semantic cycle for image classification

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part V
Novel Gabor-PHOG features for object and scene image classification

SSPR'12/SPR'12 Proceedings of the 2012 Joint IAPR international conference on Structural, Syntactic, and Statistical Pattern Recognition
The elastic net as visual category representation: visualisation and classification

ICONIP'12 Proceedings of the 19th international conference on Neural Information Processing - Volume Part II
Emotion-aware assistive system for humanistic care based on the orange computing concept

Applied Computational Intelligence and Soft Computing - Special issue on Awareness Science and Engineering
A real-time system for head tracking and pose estimation

ECCV'10 Proceedings of the 11th European conference on Trends and Topics in Computer Vision - Volume Part I
A comparative study of several feature extraction methods for person re-identification

CCBR'12 Proceedings of the 7th Chinese conference on Biometric Recognition
Image ranking via attribute boosted hypergraph

PCM'12 Proceedings of the 13th Pacific-Rim conference on Advances in Multimedia Information Processing
Online learning with multiple kernels: A review

Neural Computation
A parts-based multi-scale method for symbol recognition

GREC'11 Proceedings of the 9th international conference on Graphics Recognition: new trends and challenges
An information retrieval approach to identifying infrequent events in surveillance video

Proceedings of the 3rd ACM conference on International conference on multimedia retrieval
A performance evaluation of gradient field HOG descriptor for sketch based image retrieval

Computer Vision and Image Understanding
Finding happiest moments in a social context

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Face hallucination on personal photo albums

ACCV'12 Proceedings of the 11th international conference on Computer Vision - Volume 2
Classifying images at scene level: comparing global and local descriptors

AMR'11 Proceedings of the 9th international conference on Adaptive Multimedia Retrieval: large-scale multimedia retrieval and evaluation
How self-similar are artworks at different levels of spatial resolution?

Proceedings of the Symposium on Computational Aesthetics
WaveLBP based hierarchical features for image classification

Pattern Recognition Letters
Size does matter: how image size affects aesthetic perception?

Proceedings of the 21st ACM international conference on Multimedia
Enabling low bitrate mobile visual recognition: a performance versus bandwidth evaluation

Proceedings of the 21st ACM international conference on Multimedia
LIRE: open source image retrieval in Java

Proceedings of the 21st ACM international conference on Multimedia
Discriminative feature selection for multi-view cross-domain learning

Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
PatchNet: a patch-based image representation for interactive library-driven image editing

ACM Transactions on Graphics (TOG)
Diagnosis of depression by behavioural signals: a multimodal approach

Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge
One-class classification with Gaussian processes

Pattern Recognition
Object class detection: A survey

ACM Computing Surveys (CSUR)
Home robots, learn by themselves

UAHCI'13 Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: applications and services for quality of life - Volume Part III
An experimental study on the universality of visual vocabularies

Journal of Visual Communication and Image Representation
Cross-modal social image clustering and tag cleansing

Journal of Visual Communication and Image Representation
Laplacian affine sparse coding with tilt and orientation consistency for image classification

Journal of Visual Communication and Image Representation
Content-based diversifying leaf image retrieval

ICIC'13 Proceedings of the 9th international conference on Intelligent Computing Theories and Technology
Multiple kernel learning for emotion recognition in the wild

Proceedings of the 15th ACM on International conference on multimodal interaction
A Web-Based Multimedia Retrieval System with MCA-Based Filtering and Subspace-Based Learning Algorithms

International Journal of Multimedia Data Engineering & Management
Multi-view K-means clustering on big data

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Collaborative spatial classification

Proceedings of the Fourth International Conference on Learning Analytics And Knowledge
New color GPHOG descriptors for object and scene image classification

Machine Vision and Applications
Random subspace support vector machine ensemble for reliable face recognition

International Journal of Biometrics
Genetic programming as strategy for learning image descriptor operators

Intelligent Data Analysis
HWVP: hierarchical wavelet packet descriptors and their applications in scene categorization and semantic concept retrieval

Multimedia Tools and Applications
Multi-view traffic sign detection, recognition, and 3D localisation

Machine Vision and Applications
Sparse representation with geometric configuration constraint for line segment matching

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

The objective of this paper is classifying images by the object categories they contain, for example motorbikes or dolphins. There are three areas of novelty. First, we introduce a descriptor that represents local image shape and its spatial layout, together with a spatial pyramid kernel. These are designed so that the shape correspondence between two images can be measured by the distance between their descriptors using the kernel. Second, we generalize the spatial pyramid kernel, and learn its level weighting parameters (on a validation set). This significantly improves classification performance. Third, we show that shape and appearance kernels may be combined (again by learning parameters on a validation set). Results are reported for classification on Caltech-101 and retrieval on the TRECVID 2006 data sets. For Caltech-101 it is shown that the class specific optimization that we introduce exceeds the state of the art performance by more than 10%.