Efficient Coverage of Case Space with Active Learning

  • Authors:
  • Nuno Filipe Escudeiro;Alípio Mário Jorge

  • Affiliations:
  • Instituto Superior de Engenharia do Porto, Portugal and LIAAD INESC Porto L.A., Portugal;Faculdade de Ciencias, Universidade do Porto, Portugal and LIAAD INESC Porto L.A., Portugal

  • Venue:
  • EPIA '09 Proceedings of the 14th Portuguese Conference on Artificial Intelligence: Progress in Artificial Intelligence
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Collecting and annotating exemplary cases is a costly and critical task that is required in early stages of any classification process. Reducing labeling cost without degrading accuracy calls for a compromise solution which may be achieved with active learning. Common active learning approaches focus on accuracy and assume the availability of a pre-labeled set of exemplary cases covering all classes to learn. This assumption does not necessarily hold. In this paper we study the capabilities of a new active learning approach, d-Confidence, in rapidly covering the case space when compared to the traditional active learning confidence criterion, when the representativeness assumption is not met. Experimental results also show that d-Confidence reduces the number of queries required to achieve complete class coverage and tends to improve or maintain classification error.