Regularized logistic regression without a penalty term: An application to cancer classification with microarray data

Authors:
Concha Bielza;VíCtor Robles;Pedro LarrañAga
Affiliations:
Department of Artificial Intelligence, Technical University of Madrid, Madrid, Spain;Department of Computer Architecture and Technology, Technical University of Madrid, Madrid, Spain;Department of Artificial Intelligence, Technical University of Madrid, Madrid, Spain
Venue:
Expert Systems with Applications: An International Journal
Year:
2011

Citing 24
Cited 2

Elements of statistical computing

Elements of statistical computing
Wrappers for feature subset selection

Artificial Intelligence - Special issue on relevance
Gene Selection for Cancer Classification using Support Vector Machines

Machine Learning
A comparative assessment of classification methods

Decision Support Systems
Case-Control Study of Binary Disease Trait Considering Interactions between SNPs and Environmental Effects using Logistic Regression

BIBE '04 Proceedings of the 4th IEEE Symposium on Bioinformatics and Bioengineering
Feature selection, L1 vs. L2 regularization, and rotational invariance

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Using AUC and Accuracy in Evaluating Learning Algorithms

IEEE Transactions on Knowledge and Data Engineering
Dimension Reduction-Based Penalized Logistic Regression for Cancer Classification Using Microarray Data

IEEE/ACM Transactions on Computational Biology and Bioinformatics (TCBB)
Is cross-validation valid for small-sample microarray classification?

Bioinformatics
Supervised machine learning techniques for the classification of metabolic disorders in newborns

Bioinformatics
Classification using partial least squares with penalized logistic regression

Bioinformatics
A Fast Dual Algorithm for Kernel Logistic Regression

Machine Learning
The use of receiver operating characteristic curves in biomedical informatics

Journal of Biomedical Informatics - Special issue: Clinical machine learning
Regularized ROC method for disease classification and biomarker selection with microarray data

Bioinformatics
Gene selection in cancer classification using sparse logistic regression with Bayesian regularization

Bioinformatics
Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms (Studies in Fuzziness and Soft Computing)

Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms (Studies in Fuzziness and Soft Computing)
Statistical Comparisons of Classifiers over Multiple Data Sets

The Journal of Machine Learning Research
An Interior-Point Method for Large-Scale l1-Regularized Logistic Regression

The Journal of Machine Learning Research
Logistic regression for disease classification using microarray data

Bioinformatics
Stagewise Lasso

The Journal of Machine Learning Research
Algorithms for Sparse Linear Classifiers in the Massive Data Setting

The Journal of Machine Learning Research
EfficientL1regularized logistic regression

AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Using principal components for estimating logistic regression with high-dimensional multicollinear data

Computational Statistics & Data Analysis
Multivariate selection of genetic markers in diagnostic classification

Artificial Intelligence in Medicine

Accurate Prediction of Coronary Artery Disease Using Reliable Diagnosis System

Journal of Medical Systems
A novel classification learning framework based on estimation of distribution algorithms

International Journal of Computing Science and Mathematics

Quantified Score

Hi-index	12.05

Visualization

Abstract

Regularized logistic regression is a useful classification method for problems with few samples and a huge number of variables. This regression needs to determine the regularization term, which amounts to searching for the optimal penalty parameter and the norm of the regression coefficient vector. This paper presents a new regularized logistic regression method based on the evolution of the regression coefficients using estimation of distribution algorithms. The main novelty is that it avoids the determination of the regularization term. The chosen simulation method of new coefficients at each step of the evolutionary process guarantees their shrinkage as an intrinsic regularization. Experimental results comparing the behavior of the proposed method with Lasso and ridge logistic regression in three cancer classification problems with microarray data are shown.