High-dimensional delay selection for regression models with mutual information and distance-to-diagonal criteria

  • Authors:
  • Geoffroy Simon;Michel Verleysen

  • Affiliations:
  • Machine Learning Group - DICE, Université catholique de Louvain,Place du Levant 3, B-1348 Louvain-la-Neuve, Belgium;Machine Learning Group - DICE, Université catholique de Louvain,Place du Levant 3, B-1348 Louvain-la-Neuve, Belgium and SAMOS-MATISSE, UMR CNRS 8595, Université Paris I - Panthéon S ...

  • Venue:
  • Neurocomputing
  • Year:
  • 2007

Quantified Score

Hi-index 0.01

Visualization

Abstract

Delay selection for time series phase space reconstruction may be performed using a mutual information (MI) criterion. However, the delay selection is in that case limited to the estimation of a single delay using MI between two variables only. A high-dimensional estimator of the MI may be used to select more than one delay between more than two variables but this approach is rather time consuming. In this paper, an alternative fast criterion is proposed to optimize all delays for a high-dimensional phase space reconstruction: the distance-to-diagonal (DD) criterion, based on a geometrical heuristic. The use of the distance to diagonal criterion is illustrated and compared to MI on artificial and benchmark time series.