A penalized criterion for variable selection in classification

  • Authors:
  • Tristan Mary-Huard;Stéphane Robin;Jean-Jacques Daudin

  • Affiliations:
  • INA-PG (dépt OMIP)/INRA (dépt MIA), 16 rue Claude Bernard, Paris Cedex 05, France;INA-PG (dépt OMIP)/INRA (dépt MIA), 16 rue Claude Bernard, Paris Cedex 05, France;INA-PG (dépt OMIP)/INRA (dépt MIA), 16 rue Claude Bernard, Paris Cedex 05, France

  • Venue:
  • Journal of Multivariate Analysis
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, the problem of variable selection in classification is considered. On the basis of recent developments in model selection theory, we provide a criterion based on penalized empirical risk, where the penalization explicitly takes into account the number of variables of the considered models. Moreover, we give an oracle-type inequality that non-asymptotically guarantees the performance of the resulting classification rule. We discuss the optimality of the proposed criterion and present an application of the main result to backward and forward selection procedures.