Identifying and Correcting Mislabeled Training Instances

  • Authors:
  • Jiang-wen Sun;Feng-ying Zhao;Chong-jun Wang;Shi-fu Chen

  • Affiliations:
  • -;-;-;-

  • Venue:
  • FGCN '07 Proceedings of the Future Generation Communication and Networking - Volume 01
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In order to form a good generalization from a set of training instances, a clean training dataset is important. Unfortunately, real world data is never as perfect as we would like it to be and can often suffered from corruptions. In this paper, a new approach is proposed to identify and correct mislabeled training instances. For a given instance, we employ a Bayesian classifier to evaluate the probabili- ties of the instance belonging to all considered class labels. Then information entropy calculated from the probability distributions is used to evaluate the typicality of the instance belonging to considered class labels. Finally, the instance with low entropy, but with error prediction result, would be identified as mislabeled instance. Experimental results in- dicate that our approach gains comparative or better per- formance than previous techniques.