Efficient Cross-Validation in ILP

  • Authors:
  • Jan Struyf;Hendrik Blockeel

  • Affiliations:
  • -;-

  • Venue:
  • ILP '01 Proceedings of the 11th International Conference on Inductive Logic Programming
  • Year:
  • 2001

Quantified Score

Hi-index 0.00

Visualization

Abstract

Cross-validation is a technique used in many different machine learning approaches. Straightforward implementation of this technique has the disadvantage of causing computational overhead. However, it has been shown that this overhead often consists of redundant computations, which can be avoided by performing all folds of the cross-validation in parallel. In this paper we study to what extent such a parallel algorithm is also useful in ILP. We discuss two issues: a) the existence of dependencies between parts of a query that limit the obtainable efficiency improvements and b) the combination of parallel cross-validation with query-packs. Tentative solutions are proposed and evaluated experimentally.