Subgroup discover in large size data sets preprocessed using stratified instance selection for increasing the presence of minority classes

  • Authors:
  • José-Ramón Cano;Salvador García;Francisco Herrera

  • Affiliations:
  • Department of Computer Science, University of Jaén, 23700 Linares, Jaén, Spain;Department of Computer Science and Artificial Intelligence, University of Granada, 18071 Granada, Spain;Department of Computer Science and Artificial Intelligence, University of Granada, 18071 Granada, Spain

  • Venue:
  • Pattern Recognition Letters
  • Year:
  • 2008

Quantified Score

Hi-index 0.10

Visualization

Abstract

The subgroup discovery is defined as: ''given a population of individuals and a property of those individuals, we are interested in finding a population of subgroups as large as possible and in having the most unusual statistical characteristic with respect to the property of interest''. The subgroup discovery algorithms have to face the scaling up problem which appears in the evaluation of large size data sets. In this paper we are interested in the extraction of subgroups from large size data sets. To avoid the scaling up problem, we propose the combination of stratification and instance selection algorithms for scaling down the data set before the subgroup discovery task. In addition, two new stratification models are proposed to increase the presence of minority classes in data sets, which affects to the subgroup discovery process on them. The results show that the subgroup discovery extraction can be executed on large data sets preprocessed independently of the presence of minority classes, which could not be executed in other way.