Fast generalized cross-validation algorithm for sparse model learning

  • Authors:
  • S. Sundararajan;Shirish Shevade;S. Sathiya Keerthi

  • Affiliations:
  • Philips Electronics India Ltd., Ulsoor, Bangalore, India;Computer Science and Automation, Indian Institute of Science, Bangalore, India;Yahoo! Research, Santa Clara, CA

  • Venue:
  • Neural Computation
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a fast, incremental algorithm for designing linear regression models. The proposed algorithm generates a sparse model by optimizing multiple smoothing parameters using the generalized cross-validation approach. The performances on synthetic and real-world data sets are compared with other incremental algorithms such as Tipping and Faul's fast relevance vector machine, Chen et al.'s orthogonal least squares, and Orr's regularized forward selection. The results demonstrate that the proposed algorithm is competitive.