An optimization of ReliefF for classification in large datasets

  • Authors:
  • Yue Huang;Paul J. McCullagh;Norman D. Black

  • Affiliations:
  • Division of Epidemiology and Public Health, School of Community Health Sciences, University of Nottingham, Nottingham, UK;Faculty of Computing and Engineering, University of Ulster, Newtownabbey, Northern Ireland, UK;Research and Innovation, University of Ulster, Newtownabbey, Northern Ireland, UK

  • Venue:
  • Data & Knowledge Engineering
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

ReliefF has proved to be a successful feature selector but when handling a large dataset, it is computationally expensive. We present an optimization using Supervised Model Construction which improves starter selection. Effectiveness has been evaluated using 12 UCI datasets and a clinical diabetes database. Experiments indicate that compared with ReliefF, the proposed method improved computation efficiency whilst maintaining the classification accuracy. In the clinical dataset (20,000 records with 47 features), feature selection via Supervised Model Construction (FSSMC) reduced the processing time by 80%, compared to ReliefF, and maintained accuracy for Naive Bayes, IB1 and C4.5 classifiers.