Nonconcave Penalized Likelihood With NP-Dimensionality

Authors:
Jianqing Fan; Jinchi Lv
Affiliations:
Dept. of Oper. Res. & Financial Eng., Princeton Univ., Princeton, NJ, USA;-
Venue:
IEEE Transactions on Information Theory
Year:
2011

Citing 0
Cited 3

A multi-stage framework for Dantzig selector and LASSO

The Journal of Machine Learning Research
Shrinkage variable selection and estimation in proportional hazards models with additive structure and high dimensionality

Computational Statistics & Data Analysis
SCAD-penalized regression in additive partially linear proportional hazards models with an ultra-high-dimensional linear part

Journal of Multivariate Analysis

Quantified Score

Hi-index	754.84

Visualization

Abstract

Penalized likelihood methods are fundamental to ultrahigh dimensional variable selection. How high dimensionality such methods can handle remains largely unknown. In this paper, we show that in the context of generalized linear models, such methods possess model selection consistency with oracle properties even for dimensionality of nonpolynomial (NP) order of sample size, for a class of penalized likelihood approaches using folded-concave penalty functions, which were introduced to ameliorate the bias problems of convex penalty functions. This fills a long-standing gap in the literature where the dimensionality is allowed to grow slowly with the sample size. Our results are also applicable to penalized likelihood with the L1-penalty, which is a convex function at the boundary of the class of folded-concave penalty functions under consideration. The coordinate optimization is implemented for finding the solution paths, whose performance is evaluated by a few simulation examples and the real data analysis.