Introduction to statistical pattern recognition (2nd ed.)
Introduction to statistical pattern recognition (2nd ed.)
Mathematical Programming: Series A and B - Special issue: Festschrift in Honor of Philip Wolfe part II: studies in nonlinear programming
Learning the Kernel Matrix with Semidefinite Programming
The Journal of Machine Learning Research
In Defense of One-Vs-All Classification
The Journal of Machine Learning Research
A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data
The Journal of Machine Learning Research
A Direct Method for Building Sparse Kernel Learning Algorithms
The Journal of Machine Learning Research
Multi-Task Learning for Classification with Dirichlet Process Priors
The Journal of Machine Learning Research
Uncovering shared structures in multiclass classification
Proceedings of the 24th international conference on Machine learning
A least squares formulation for canonical correlation analysis
Proceedings of the 25th international conference on Machine learning
Convex multi-task feature learning
Machine Learning
Multi-label dimensionality reduction via dependence maximization
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 3
A shared-subspace learning framework for multi-label classification
ACM Transactions on Knowledge Discovery from Data (TKDD)
Heterogeneous feature selection by group lasso with logistic regression
Proceedings of the international conference on Multimedia
Multi-label linear discriminant analysis
ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Image annotation by composite kernel learning with group structure
MM '11 Proceedings of the 19th ACM international conference on Multimedia
Supervised subspace learning with multi-class lagrangian SVM on the grassmann manifold
AI'11 Proceedings of the 24th international conference on Advances in Artificial Intelligence
Proceedings of the ACM Conference on Bioinformatics, Computational Biology and Biomedicine
Multi-label ensemble based on variable pairwise constraint projection
Information Sciences: an International Journal
Image annotation by semi-supervised cross-domain learning with group sparsity
Journal of Visual Communication and Image Representation
Pattern Recognition Letters
Hi-index | 0.00 |
Dimensionality reduction is an essential step in high-dimensional data analysis. Many dimensionality reduction algorithms have been applied successfully to multi-class and multi-label problems. They are commonly applied as a separate data preprocessing step before classification algorithms. In this paper, we study a joint learning framework in which we perform dimensionality reduction and multi-label classification simultaneously. We show that when the least squares loss is used in classification, this joint learning decouples into two separate components, i.e., dimensionality reduction followed by multi-label classification. This analysis partially justifies the current practice of a separate application of dimensionality reduction for classification problems. We extend our analysis using other loss functions, including the hinge loss and the squared hinge loss. We further extend the formulation to the more general case where the input data for different class labels may differ, overcoming the limitation of traditional dimensionality reduction algorithms. Experiments on benchmark data sets have been conducted to evaluate the proposed joint formulations.