Fuzzy kappa for the agreement measure of fuzzy classifications

Authors:
Weibei Dou;Yuan Ren;Qian Wu;Su Ruan;Yanping Chen;Daniel Bloyet;Jean-Marc Constans
Affiliations:
Department of Electronic Engineering, Tsinghua University, 100084 Beijing, China and GREYC-CNRS UMR 6072, 6 Boulevard Maréchal Juin, 14050 Caen, France;Department of Electronic Engineering, Tsinghua University, 100084 Beijing, China;Department of Electronic Engineering, Tsinghua University, 100084 Beijing, China;cCReSTIC, 9 Rue de Qubec,10026 Troyes, France;Imaging Diagnostic Center, Nanfang Hospital Guangzhou, China;GREYC-CNRS UMR 6072, 6 Boulevard Maréchal Juin, 14050 Caen, France;Unité d'IRM, EA3916, CHRU, 14033 Caen, France
Venue:
Neurocomputing
Year:
2007

Citing 6
Cited 5

Similarity measure between fuzzy sets and between elements

Fuzzy Sets and Systems
Measures of similarity between vague sets

Fuzzy Sets and Systems
Assessing agreement on classification tasks: the kappa statistic

Computational Linguistics
Fuzzy Markovian segmentation in application of magnetic resonance images

Computer Vision and Image Understanding
Measuring agreement in medical informatics reliability studies

Journal of Biomedical Informatics
On the Relation Between Dependence and Diversity in Multiple Classifier Systems

ITCC '05 Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC'05) - Volume I - Volume 01

Fuzzy Variant of Affinity Propagation in Comparison to Median Fuzzy c-Means

WSOM '09 Proceedings of the 7th International Workshop on Advances in Self-Organizing Maps
Median fuzzy c-means for clustering dissimilarity data

Neurocomputing
Fixed-effects modeling of Cohen's weighted kappa for bivariate multinomial data

Computational Statistics & Data Analysis
Inequalities between multi-rater kappas

Advances in Data Analysis and Classification
Clustering by fuzzy neural gas and evaluation of fuzzy clusters

Computational Intelligence and Neuroscience

Quantified Score

Hi-index	0.01

Visualization

Abstract

In this paper, we propose an assessment method of agreement between fuzzy sets, called fuzzy Kappa which is deduced from the concept of Cohen's Kappa statistic. In fuzzy case, the Cohen's Kappa coefficient can be calculated generally by transforming the fuzzy sets into some crisp @a-cut subsets. While the proposed fuzzy Kappa allows to directly evaluate an overall agreement between two fuzzy sets. Hence, it is an efficient agreement measure between a given fuzzy ''ground truth'' or reference and a result of fuzzy classification or fuzzy segmentation. Based on membership function, we define its agreement function and its probability distribution to formulate the deduction of the expectation agreement. So the fuzzy Kappa is calculated from the proportion of the observed agreement and the agreement expected by chance. All the definitions and deductions are detailed in this paper. Both Cohen's Kappa and the fuzzy Kappa are then used to evaluate the agreement between a fuzzy classification of brain tissues on MRI images and its ''ground truth''. A comparison of the two types of Kappa coefficient is carried out and shows the advantage of the fuzzy Kappa and some limitations of Cohen's Kappa in the fuzzy case.