TunedIT.org: system for automated evaluation of algorithms in repeatable experiments

  • Authors:
  • Marcin Wojnarski;Sebastian Stawicki;Piotr Wojnarowski

  • Affiliations:
  • TUNEDIT Solutions, Warszawa, Poland and Faculty of Mathematics, Informatics and Mechanics, University of Warsaw, Warszawa, Poland;Faculty of Mathematics, Informatics and Mechanics, University of Warsaw, Warszawa, Poland;TUNEDIT Solutions, Warszawa, Poland and Faculty of Mathematics, Informatics and Mechanics, University of Warsaw, Warszawa, Poland

  • Venue:
  • RSCTC'10 Proceedings of the 7th international conference on Rough sets and current trends in computing
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present TUNEDIT system which facilitates evaluation and comparison of machine-learning algorithms. TUNEDIT is composed of three complementary and interconnected components: TunedTester, Repository and Knowledge Base. TunedTester is a stand-alone Java application that runs automated tests (experiments) of algorithms. Repository is a database of algorithms, datasets and evaluation procedures used by TunedTester for setting up a test. Knowledge Base is a database of test results. Repository and Knowledge Base are accessible through TUNEDIT website. TUNEDIT is open and free for use by any researcher. Every registered user can upload new resources to Repository, run experiments with TunedTester, send results to Knowledge Base and browse all collected results, generated either by himself or by others. As a special functionality, built upon the framework of automated tests, TUNEDIT provides a platform for organization of on-line interactive competitions for machine-learning problems. This functionality may be used, for instance, by teachers to launch contests for their students instead of traditional assignment tasks; or by organizers of machine-learning and data-mining conferences to launch competitions for the scientific community, in association with the conference.