Slope heuristics: overview and implementation

Authors:
Jean-Patrick Baudry;Cathy Maugis;Bertrand Michel
Affiliations:
Laboratoire de Mathématiques d'Orsay, Université Paris-Sud 11 and INRIA SELECT, Orsay Cedex, France 91405 and Laboratoire MAP5, Université Paris Descartes and CNRS, Paris, France;INSA de Toulouse, Département de Génie Mathématique, Institut de Mathématiques de Toulouse, Toulouse Cedex 4, France 31077;Laboratoire de Statistique Théorique et Appliquée, Université Pierre et Marie Curie, Paris, France 75005
Venue:
Statistics and Computing
Year:
2012

Citing 4
Cited 2

Enhanced Model-Based Clustering, Density Estimation,and Discriminant Analysis Software: MCLUST

Journal of Classification
Detecting multiple change-points in the mean of Gaussian process by model selection

Signal Processing
Data-driven Calibration of Penalties for Least-Squares Regression

The Journal of Machine Learning Research
Model-based cluster and discriminant analysis with the MIXMOD software

Computational Statistics & Data Analysis

Tuning parameter selection in sparse regression modeling

Computational Statistics & Data Analysis
Multilayer perceptron for the learning of spatio-temporal dynamics-application in thermal engineering

Engineering Applications of Artificial Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

Model selection is a general paradigm which includes many statistical problems. One of the most fruitful and popular approaches to carry it out is the minimization of a penalized criterion. Birgé and Massart (Probab. Theory Relat. Fields 138:33---73, 2006) have proposed a promising data-driven method to calibrate such criteria whose penalties are known up to a multiplicative factor: the "slope heuristics". Theoretical works validate this heuristic method in some situations and several papers report a promising practical behavior in various frameworks. The purpose of this work is twofold. First, an introduction to the slope heuristics and an overview of the theoretical and practical results about it are presented. Second, we focus on the practical difficulties occurring for applying the slope heuristics. A new practical approach is carried out and compared to the standard dimension jump method. All the practical solutions discussed in this paper in different frameworks are implemented and brought together in a Matlab graphical user interface called capushe. Supplemental Materials containing further information and an additional application, the capushe package and the datasets presented in this paper, are available on the journal Web site.