Logistic Ensembles for Random Spherical Linear Oracles

  • Authors:
  • Leif E. Peterson;Matthew A. Coleman

  • Affiliations:
  • -;-

  • Venue:
  • ICMLA '07 Proceedings of the Sixth International Conference on Machine Learning and Applications
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

classifier for DNA microarray gene expression data is proposed. The oracle assigns different training(testing) samples to 2 subclassifiers of the same type using hyperplane splits in order to increase the diversity of voting results since errors are not shared across sub-classifiers. Eleven classifiers were evaluated for performance as the base classifier including k nearest neighbor (kNN), na篓ive Bayes classifier (NBC), linear discriminant analysis (LDA), learning vector quantization (LVQ1), polytomous logistic regression (PLOG), artificial neural networks (ANN), constricted particle swarm optimization (CPSO), kernel regression (KREG), radial basis function networks (RBFN), gradient descent support vector machines (SVMGD), and least squares support vector machines (SVMLS). Logistic ensembles (PLOG) resulted in the best performance when used as a base classifier for RSLO. Random hyperplane splits used in RSLO resulted in degeneration of performance at the greatest levels of CV-fold and iteration number when compared with hyperplane splits in principal direction linear oracle (PDLO), which increased with increasing CV-fold and iteration number.