Reply to the Comments on "Local Overfitting Control via Leverages" in "Jacobian Conditioning Analysis for Model Validation" by I. Rivals and L. Personnaz

Authors:
Yacine Oussar;Gaétan Monari
Affiliations:
ESPCI, Laboratoire d'Electronique, F-75005 Paris, France;ESPCI, Laboratoire d'Electronique, F-75005 Paris, France
Venue:
Neural Computation
Year:
2004

Citing 5
Cited 1

Construction of confidence intervals for neural networks based on least squares estimation

Neural Networks
Comments for: Rivals, I., & Personnaz, L. (2000).: construction of confidence intervals for neural networks based on least squares estimation

Neural Networks
Local overfitting control via leverages

Neural Computation
Mlps (mono layer polynomials and multi layer perceptrons) for nonlinear modeling

The Journal of Machine Learning Research
A comparison of some error estimates for neural network models

Neural Computation

Graph machines and their applications to computer-aided drug design: a new approach to learning from structured data

UC'06 Proceedings of the 5th international conference on Unconventional Computation

Quantified Score

Hi-index	0.00

Visualization

Abstract

"Jacobian Conditioning Analysis for Model Validation" by Rivals and Personnaz in this issue is a comment on Monari and Dreyfus (2002). In this reply, we disprove their claims. We point to flawed reasoning in the theoretical comments and to errors and inconsistencies in the numerical examples. Our replies are substantiated by seven counterexamples, inspired by actual data, which show that the comments on the accuracy of the computation of the leverages are unsupported and that following the approach they advocate leads to discarding valid models or validating overfitted models.