Increasing efficiency of data mining systems by machine unification and double machine cache

  • Authors:
  • Norbert Jankowski;Krzysztof Grąbczewski

  • Affiliations:
  • Department of Informatics, Nicolaus Copernicus University, Toruń, Poland;Department of Informatics, Nicolaus Copernicus University, Toruń, Poland

  • Venue:
  • ICAISC'10 Proceedings of the 10th international conference on Artificial intelligence and soft computing: Part I
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In advanced meta-learning algorithms and in general data mining systems, we need to search through huge spaces of machine learning algorithms. Meta-learning and other complex data mining approaches need to train and test thousands of learning machines while searching for the best solution (model), which often is quite complex. To facilitate working with projects of any scale, we propose intelligent mechanism of machine unification and cooperating mechanism of machine cache. Data mining system equipped with the mechanisms can deal with projects many times bigger than systems devoid of machine unification and cache. Presented solutions also reduce computational time needed for learning and save memory.