Group-induced vector spaces

Authors:
Manuele Bicego;Elżbieta Pekalska;Robert P. W. Duin
Affiliations:
DEIR, University of Sassari, Italy;School of Computer Science, University of Manchester, UK;Delft University of Technology, The Netherlands
Venue:
MCS'07 Proceedings of the 7th international conference on Multiple classifier systems
Year:
2007

Citing 8
Cited 2

Combination of Multiple Classifiers Using Local Accuracy Estimates

IEEE Transactions on Pattern Analysis and Machine Intelligence
Dimension reduction by local principal component analysis

Neural Computation
Mixtures of probabilistic principal component analyzers

Neural Computation
Exploiting generative models in discriminative classifiers

Proceedings of the 1998 conference on Advances in neural information processing systems II
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Semisupervised Learning of Classifiers: Theory, Algorithms, and Their Application to Human-Computer Interaction

IEEE Transactions on Pattern Analysis and Machine Intelligence
Fast learning in networks of locally-tuned processing units

Neural Computation
Rapid and brief communication: A study on the performances of dynamic classifier selection based on local accuracy estimation

Pattern Recognition

Component-based discriminative classification for hidden Markov models

Pattern Recognition
Clustering-Based Construction of Hidden Markov Models for Generative Kernels

EMMCVPR '09 Proceedings of the 7th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

The strength of classifier combination lies either in a suitable averaging over multiple experts/sources or in a beneficial integration of complementary approaches. In this paper we focus on the latter and propose the use of group-induced vector spaces (GIVSs) as a way to combine unsupervised learning with classification. In such an integrated approach, the data is first modelled by a number of groups, found by a clustering procedure. Then, a proximity function is used to measure the (dis)similarity of an object to each group. A GIVS is defined by mapping an object to a vector of proximity scores, computed with respect to the given groups. In this study, we focus on a particular aspect of using GIVSs in a mode of building a trained combiner, namely the integration of generative and discriminative methods. First, in the generative step, we model the groups by simple generative models, building the GIVS space. The classification problem is then mapped in the resulting vector space, where a discriminative classifier is trained. Our experiments show that the integrated approach leads to comparable or better results than the generative methods in the original feature spaces.