On Model Selection Consistency of Lasso
The Journal of Machine Learning Research
| Hi-index | 7.29 |
The one-step estimator, covering various penalty functions, enjoys the oracle property with a good initial estimator. The initial estimator can be chosen as the least squares estimator or maximum likelihood estimator in low-dimensional settings. However, it is not available in ultrahigh dimensionality. In this paper, we study the one-step estimator with the initial estimator being marginal ordinary least squares estimates in the ultrahigh linear model. Under some appropriate conditions, we show that the one-step estimator is selection consistent. Finite sample performance of the proposed procedure is assessed by Monte Carlo simulation studies.