Active learning from stream data using optimal weight classifier ensemble

  • Authors:
  • Xingquan Zhu;Peng Zhang;Xiaodong Lin;Yong Shi

  • Affiliations:
  • Department of Computer Science and Engineering, Florida Atlantic University, Boca Raton, FL and QCIS Center, Faculty of Engineering and Information Technology, University of Technology, Sydney, NS ...;Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China;Department of Management Science and Information Systems, Rutgers Business School, Rutgers, the State University of New Jersey, Newark, NJ;College of Information Science and Technology, University of Nebraska at Omaha, NE and Fictitious Economy and Data Science Research Center, Chinese Academy of Sciences, Beijing, China

  • Venue:
  • IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose a new research problem on active learning from data streams, where data volumes grow continuously, and labeling all data is considered expensive and impractical. The objective is to label a small portion of stream data from which a model is derived to predict future instances as accurately as possible. To tackle the technical challenges raised by the dynamic nature of the stream data, i.e., increasing data volumes and evolving decision concepts, we propose a classifierensemble-based active learning framework that selectively labels instances from data streams to build a classifier ensemble. We argue that a classifier ensemble's variance directly corresponds to its error rate, and reducing a classifier ensemble's variance is equivalent to improving its prediction accuracy. Because of this, one should label instances toward theminimization of the variance of the underlying classifier ensemble. Accordingly, we introduce a minimum-variance (MV) principle to guide the instance labeling process for data streams. In addition, we derive an optimal-weight calculationmethod to determine the weight values for the classifier ensemble. The MV principle and the optimal weighting module are combined to build an active learning framework for data streams. Experimental results on synthetic and real-world data demonstrate the performance of the proposed work in comparison with other approaches.