Feature subset selection for learning preferences: a case study

Authors:
Antonio Bahamonde;Gustavo F. Bayón;Jorge Díez;José Ramón Quevedo;Oscar Luaces;Juan José del Coz;Jaime Alonso;Félix Goyache
Affiliations:
University of Oviedo at Gijón, (Asturias), Spain;University of Oviedo at Gijón, (Asturias), Spain;University of Oviedo at Gijón, (Asturias), Spain;University of Oviedo at Gijón, (Asturias), Spain;University of Oviedo at Gijón, (Asturias), Spain;University of Oviedo at Gijón, (Asturias), Spain;University of Oviedo at Gijón, (Asturias), Spain;SERIDA-CENSYRA-Somió, (Asturias), Spain
Venue:
ICML '04 Proceedings of the twenty-first international conference on Machine learning
Year:
2004

Citing 16
Cited 10

Connectionist learning of expert preferences by comparison training

Advances in neural information processing systems 1
The nature of statistical learning theory

The nature of statistical learning theory
Wrappers for feature subset selection

Artificial Intelligence - Special issue on relevance
Making large-scale support vector machine learning practical

Advances in kernel methods
Gene Selection for Cancer Classification using Support Vector Machines

Machine Learning
Metric-Based Methods for Adaptive Model Selection and Regularization

Machine Learning
A Practical Approach to Feature Selection

ML '92 Proceedings of the Ninth International Workshop on Machine Learning
Learning Subjective Functions with Large Margins

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Learning to Assess from Pair-Wise Comparisons

IBERAMIA 2002 Proceedings of the 8th Ibero-American Conference on AI: Advances in Artificial Intelligence
Optimizing search engines using clickthrough data

Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
Extensions to metric based model selection

The Journal of Machine Learning Research
Overfitting in making comparisons between variable selection methods

The Journal of Machine Learning Research
Learning to order things

Journal of Artificial Intelligence Research
A study of cross-validation and bootstrap for accuracy estimation and model selection

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 2
A new metric-based approach to model selection

AAAI'97/IAAI'97 Proceedings of the fourteenth national conference on artificial intelligence and ninth conference on Innovative applications of artificial intelligence
A PAC-Bayesian margin bound for linear classifiers

IEEE Transactions on Information Theory

Preference learning with Gaussian processes

ICML '05 Proceedings of the 22nd international conference on Machine learning
Clustering people according to their preference criteria

Expert Systems with Applications: An International Journal
Ranking Attributes Using Learning of Preferences by Means of SVM

Current Topics in Artificial Intelligence
Learning to Predict One or More Ranks in Ordinal Regression Tasks

ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
Predicting the probability of survival in intensive care unit patients from a small number of variables and training examples

Artificial Intelligence in Medicine
Prediction and Inheritance of Phenotypes

IWINAC '09 Proceedings of the 3rd International Work-Conference on The Interplay Between Natural and Artificial Computation: Part I: Methods and Models in Artificial and Natural Computation. A Homage to Professor Mira's Scientific Legacy
Prediction of probability of survival in critically ill patients optimizing the area under the ROC curve

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Preference learning for cognitive modeling: a case study on entertainment preferences

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
A kernel based method for discovering market segments in beef meat

PKDD'05 Proceedings of the 9th European conference on Principles and Practice of Knowledge Discovery in Databases
Learning the reasons why groups of consumers prefer some food products

ICDM'06 Proceedings of the 6th Industrial Conference on Data Mining conference on Advances in Data Mining: applications in Medicine, Web Mining, Marketing, Image and Signal Mining

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we tackle a real world problem, the search of a function to evaluate the merits of beef cattle as meat producers. The independent variables represent a set of live animals' measurements; while the outputs cannot be captured with a single number, since the available experts tend to assess each animal in a relative way, comparing animals with the other partners in the same batch. Therefore, this problem can not be solved by means of regression methods; our approach is to learn the preferences of the experts when they order small groups of animals. Thus, the problem can be reduced to a binary classification, and can be dealt with a Support Vector Machine (SVM) improved with the use of a feature subset selection (FSS) method. We develop a method based on Recursive Feature Elimination (RFE) that employs an adaptation of a metric based method devised for model selection (ADJ). Finally, we discuss the extension of the resulting method to more general settings, and provide a comparison with other possible alternatives.