Learning valued preference structures for solving classification problems

Authors:
Eyke Hüllermeier;Klaus Brinker
Affiliations:
Department of Mathematics and Computer Science, Philipps-Universität Marburg, Germany;Department of Mathematics and Computer Science, Philipps-Universität Marburg, Germany
Venue:
Fuzzy Sets and Systems
Year:
2008

Citing 13
Cited 18

Using fuzzy binary relations for identifying noninterior decision alternatives

Fuzzy Sets and Systems
The use of fuzzy outranking relations in preference modelling

Fuzzy Sets and Systems - Special issue dedicated to Professor Claude Ponsard
The Optimum Class-Selective Rejection Rule

IEEE Transactions on Pattern Analysis and Machine Intelligence
AI Game Programming Wisdom

AI Game Programming Wisdom
Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond

Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond
Reliable Classifications with Machine Learning

ECML '02 Proceedings of the 13th European Conference on Machine Learning
Round Robin Rule Learning

ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Reducing multiclass to binary: a unifying approach for margin classifiers

The Journal of Machine Learning Research
Round robin classification

The Journal of Machine Learning Research
Version Space Support Vector Machines

Proceedings of the 2006 conference on ECAI 2006: 17th European Conference on Artificial Intelligence August 29 -- September 1, 2006, Riva del Garda, Italy
Solving multiclass learning problems via error-correcting output codes

Journal of Artificial Intelligence Research
Learning label preferences: ranking error versus position error

IDA'05 Proceedings of the 6th international conference on Advances in Intelligent Data Analysis
Representing partial ignorance

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans

Combining predictions in pairwise classification: An optimal adaptive voting strategy and its relation to weighted voting

Pattern Recognition
FR3: a fuzzy rule learner for inducing reliable classifiers

IEEE Transactions on Fuzzy Systems
Solving multi-class problems with linguistic fuzzy rule based classification systems based on pairwise learning and preference relations

Fuzzy Sets and Systems
Multi-class imbalanced data-sets with linguistic fuzzy rule based classification systems based on pairwise learning

IPMU'10 Proceedings of the Computational intelligence for knowledge-based systems design, and 13th international conference on Information processing and management of uncertainty
Uncertainty in clustering and classification

SUM'10 Proceedings of the 4th international conference on Scalable uncertainty management
An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes

Pattern Recognition
Learning from label preferences

DS'11 Proceedings of the 14th international conference on Discovery science
A class of fuzzy multisets with a fixed number of memberships

Information Sciences: an International Journal
An alternative to fuzzy methods in decision-making problems

Expert Systems with Applications: An International Journal
Detecting free space and obstacles in omnidirectional images

ICIRA'11 Proceedings of the 4th international conference on Intelligent Robotics and Applications - Volume Part I
Supervised learning algorithms for multi-class classification problems with partial class memberships

Fuzzy Sets and Systems
Fuzzy machine learning and data mininga

Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery
Introducing the Discriminative Paraconsistent Machine (DPM)

Information Sciences: an International Journal
A structured view on sources of uncertainty in supervised learning

SUM'12 Proceedings of the 6th international conference on Scalable Uncertainty Management
Analysing the classification of imbalanced data-sets with multiple classes: Binarization techniques and ad-hoc approaches

Knowledge-Based Systems
Ordering based decision making - A survey

Information Fusion
Consensus in multi-expert decision making problems using penalty functions defined over a Cartesian product of lattices

Information Fusion
Construction of interval-valued fuzzy preference relations from ignorance functions and fuzzy preference relations. Application to decision making

Knowledge-Based Systems

Quantified Score

Hi-index	0.21

Visualization

Abstract

This paper introduces a new approach to classification which combines pairwise decomposition techniques with ideas and tools from fuzzy preference modeling. More specifically, our approach first decomposes a polychotomous classification problem involving m classes into an ensemble of binary problems, one for each ordered pair of classes. The corresponding classifiers are trained on the relevant subsets of the (transformed) original training data. In the classification phase, a new query is submitted to every binary learner. The output of each classifier is interpreted as a fuzzy degree of preference for the first in comparison with the second class. By combining the outputs of all classifiers, one thus obtains a fuzzy preference relation which is taken as a point of departure for the final classification decision. This way, the problem of classification is effectively reduced to a problem of decision making based on a fuzzy preference relation. Corresponding techniques, which have been investigated quite intensively in the field of fuzzy set theory, hence become amenable to the task of classification. In particular, by decomposing a preference relation into a strict preference, an indifference, and an incomparability relation, this approach allows one to quantify different types of uncertainty in classification and thereby supports sophisticated classification and postprocessing strategies.